00000001:02000400:1.0F:1786400188.755069:0:2970:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1786400211.406207:0:3191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1786400213.708594:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 517 MB/s 00000001:01000000:0.0F:1786400213.957826:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 599 MB/s 00000001:01000000:1.0:1786400214.218584:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2546 MB/s 00000020:02000000:1.0:1786400215.023947:0:3284:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_107_gf473267 00000400:02000000:1.0:1786400216.054560:0:3299:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.201.123@tcp [8/256/0/180] 00008000:02000000:2.0:1786400219.952055:0:3448:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1786400280.579853:0:5257:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1786400291.888271:0:5796:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786400291.888279:0:5796:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1786400291.888396:0:5796:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000005e0d9a48 00000080:02000400:2.0:1786400291.888407:0:5796:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1786400291.892479:0:5796:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1786400291.892494:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786400291.892534:0:5796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000091852f9a) 00000020:00000080:2.0:1786400291.892553:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1786400291.916350:0:5796:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1786400291.916992:0:5796:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1786400291.943686:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1786400291.943726:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786400291.943923:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786400291.943981:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786400291.944019:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786400291.944494:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1786400291.944502:0:5796:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786400291.944512:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a4de4 00000020:01000004:3.0:1786400291.944519:0:5796:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1786400291.944523:0:5796:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1786400291.944527:0:5796:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e0d9a48 from MGS 00000020:01000004:3.0:1786400291.944532:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1786400291.944623:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000788a1fb) 00000020:00000080:3.0:1786400291.944642:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1786400291.944841:0:5796:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e0d9a48 from MGS, refs=2 00080000:01000000:3.0:1786400291.944846:0:5796:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1786400291.944927:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a4df2 00000100:00100000:3.0:1786400291.945038:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1786400291.945246:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1786400291.945253:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1786400291.945978:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1786400291.945986:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1786400291.946959:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400291.947198:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1786400291.947204:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1786400291.947953:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1786400291.947961:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1786400291.948833:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1786400291.948842:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1786400291.949623:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400291.949626:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400291.949628:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400291.950307:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400291.950310:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400291.950312:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400291.951244:0:5796:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1786400291.962238:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1786400292.201040:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2627 MB/s 00000001:01000000:0.0:1786400292.452951:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2138 MB/s 00000001:01000000:0.0:1786400292.705455:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 379 MB/s 00000001:01000000:2.0:1786400292.956789:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 694 MB/s 00080000:10000000:3.0:1786400292.980935:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1786400293.007484:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1786400293.007506:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1786400293.007509:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1786400293.011219:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786400293.030725:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1786400293.031135:0:5796:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1786400293.031202:0:5796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1786400293.031521:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1786400293.031550:0:5796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1786400293.031946:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400293.032120:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1786400293.032127:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1786400293.035628:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1786400293.035641:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1786400293.037490:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1786400293.037503:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1786400293.043988:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1786400293.044013:0:5796:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.123@tcp' 00000020:01000004:1.0:1786400293.044015:0:5796:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1786400293.044063:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.123@tcp (typ=mgc) 00000020:00000080:1.0:1786400293.044100:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.123@tcp (00000000db73139b) 00000020:00000080:1.0:1786400293.044119:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1786400293.044263:0:5796:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cce271fb@MGC192.168.201.123@tcp: add connection 192.168.201.123@tcp at head 00010000:00010000:1.0:1786400293.044581:0:5796:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.123@tcp-0 is initialized 00000040:01000000:1.0:1786400293.044588:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 1 is initialized 00000100:00080000:2.0:1786400293.047157:0:5812:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1786400293.050386:0:5813:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1786400293.050526:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.123@tcp (uuid 6e769e6f-cf99-4814-98f1-5b8d54010374) 00000020:00000080:3.0:1786400293.050551:0:5796:0:(genops.c:1406:class_connect()) connect: client 6e769e6f-cf99-4814-98f1-5b8d54010374, cookie 0x49554f35ff0a4e00 00000100:00080000:3.0:1786400293.050563:0:5796:0:(import.c:510:import_select_connection()) MGC192.168.201.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786400293.050568:0:5796:0:(import.c:624:import_select_connection()) MGC192.168.201.123@tcp: import 00000000cce271fb using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1786400293.050616:0:5796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009799d0bb x1873176392892544/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786400293.050646:0:5796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS 00000020:01000004:3.0:1786400293.050669:0:5796:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1786400293.050692:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1786400293.050706:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f39f0ab2) 00000020:00000080:3.0:1786400293.050719:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1786400293.051003:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009799d0bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e769e6f-cf99-4814-98f1-5b8d54010374:3314:1873176392892544:0@lo:250: 00000100:00100000:1.0:1786400293.051100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400293.051179:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392892544 00000100:00100000:1.0:1786400293.051187:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392892544 00000100:00100000:1.0:1786400293.051216:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400293.051222:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ded4c33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1873176392892544:12345-0@lo:250: 00010000:00080000:1.0:1786400293.051245:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6e769e6f-cf99-4814-98f1-5b8d54010374@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1786400293.051264:0:5809:0:(genops.c:1406:class_connect()) connect: client 6e769e6f-cf99-4814-98f1-5b8d54010374, cookie 0x49554f35ff0a4e0e 00000100:00080000:1.0:1786400293.051394:0:5809:0:(import.c:65:import_set_state_nolock()) 00000000d802490a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400293.051444:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ded4c33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+5:3314:x1873176392892544:12345-0@lo:250: Request processed in 221us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400293.051459:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400293.051499:0:3314:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1786400293.051507:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.123@tcp: connect to target with instance 0 00000100:00080000:1.0:1786400293.051513:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1786400293.051516:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1786400293.051519:0:3314:0:(import.c:65:import_set_state_nolock()) 00000000cce271fb MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1786400293.051521:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1786400293.051528:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1786400293.051533:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009799d0bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e769e6f-cf99-4814-98f1-5b8d54010374:3314:1873176392892544:0@lo:250: 00000100:00100000:2.0:1786400293.088788:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400293.088999:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1786400293.089006:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1786400293.091798:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1786400293.091814:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1786400293.093232:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1786400293.093251:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1786400293.094727:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400293.095157:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1786400293.095164:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1786400293.095852:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1786400293.095860:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1786400293.168036:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400293.168265:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1786400293.168271:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1786400293.169863:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1786400293.169874:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1786400293.170968:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400293.171612:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786400293.171619:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1786400293.179468:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1786400293.179479:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1786400293.180178:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400293.180586:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786400293.180591:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1786400293.197528:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786400293.202118:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1786400293.204269:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400293.204509:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786400293.204524:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1786400293.205558:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786400293.205567:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1786400293.250004:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400293.250232:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1786400293.250239:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1786400293.251992:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1786400293.252015:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1786400293.256134:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1786400293.256154:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1786400293.259123:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1786400293.259153:0:5796:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1786400293.259160:0:5796:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1786400293.259324:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786400293.259366:0:5796:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.123@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1786400293.259372:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786400293.259373:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786400293.259374:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400293.259376:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400293.259377:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400293.259378:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400293.259379:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786400293.259381:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786400293.259382:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786400293.259384:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786400293.259385:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400293.259386:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786400293.259389:0:5796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1786400293.259391:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786400293.259392:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786400293.259393:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400293.259394:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400293.259395:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400293.259396:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400293.259397:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786400293.259398:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786400293.259398:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786400293.259399:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786400293.259400:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400293.259401:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786400293.259435:0:5796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786400293.259452:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000007de80c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392892672:0@lo:253: 00000100:00100000:2.0:1786400293.259534:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400293.259595:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000028f36e66 going to sleep for 11 seconds 00000100:00100000:1.0:1786400293.261701:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392892672 00000100:00100000:1.0:1786400293.261715:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392892672 00000100:00100000:1.0:1786400293.261802:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400293.261811:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000193fb012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+5:5796:x1873176392892672:12345-0@lo:253: 20000000:01000000:1.0:1786400293.261876:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786400293.261879:0:5811:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1786400293.262655:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1786400293.262723:0:5811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1786400293.263067:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400293.268230:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1786400293.268939:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1786400293.268945:0:5811:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1786400293.268951:0:5811:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1786400293.268954:0:5811:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1786400293.268970:0:5811:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1786400293.269245:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786400293.269582:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1786400293.269597:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1786400293.269642:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1786400293.269687:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1786400293.269723:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1786400293.269848:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1786400293.269857:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1786400293.269902:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1786400293.269919:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1786400293.269953:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1786400293.269960:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1786400293.270003:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1786400293.270050:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1786400293.270078:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1786400293.270504:0:5811:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1786400293.270533:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786400293.270723:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1786400293.270735:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1786400293.270794:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1786400293.270824:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1786400293.270871:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1786400293.270884:0:5811:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1786400293.270954:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1786400293.270963:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1786400293.271033:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1786400293.271098:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1786400293.271138:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1786400293.271150:0:5811:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1786400293.271247:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1786400293.271257:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1786400293.271292:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1786400293.271325:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1786400293.271503:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1786400293.271556:0:5811:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1786400293.271564:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1786400293.272522:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1786400293.272931:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1786400293.272956:0:5811:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.123@tcp for mdt 20000000:01000000:0.0:1786400293.272958:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:0.0:1786400293.273006:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1786400293.273015:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1786400293.273060:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1786400293.273067:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:0.0:1786400293.273275:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1786400293.273287:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1786400293.288621:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1786400293.288697:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1786400293.288859:0:5811:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1786400293.288862:0:5811:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1786400293.288868:0:5811:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1786400293.288883:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1786400293.288886:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1786400293.288916:0:5811:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1786400293.288919:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1786400293.290500:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1786400293.290867:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1786400293.290912:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1786400293.291009:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1786400293.291023:0:5811:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1786400293.291026:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1786400293.293282:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1786400293.293797:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1786400293.294040:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1786400293.294102:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1786400293.294119:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786400293.294121:0:5811:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1786400293.294126:0:5811:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1786400293.294128:0:5811:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1786400293.294134:0:5811:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1786400293.294141:0:5811:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1786400293.299861:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1786400293.300037:0:5811:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1786400293.312232:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1786400293.312294:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1786400293.312371:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1786400293.312393:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786400293.312413:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.312432:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.312440:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.312461:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.312467:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.312473:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.312479:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6685c81 already unused, calling callback (00000000de688fac) 00010000:00010000:1.0:1786400293.315448:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.315472:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.316169:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.316184:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.316190:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786400293.316210:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1786400293.615670:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000193fb012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+5:5796:x1873176392892672:12345-0@lo:253: Request processed in 353853us (356130us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400293.615691:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400293.615826:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000007de80c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392892672:0@lo:253: 10000000:01000000:2.0:1786400293.615841:0:5796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786400293.615849:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786400293.615851:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786400293.615852:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400293.615853:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1786400293.615855:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400293.615856:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400293.615857:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786400293.615859:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786400293.615860:0:5796:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1786400293.615861:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400293.615863:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786400293.615879:0:5796:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e0d9a48 from lustre-MDT0000 10000000:01000000:2.0:1786400293.615904:0:5796:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1786400293.615907:0:5796:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1786400293.615911:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9373a0c50000 10000000:01000000:2.0:1786400293.615915:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786400293.615922:0:5796:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9373a0c50000 from 1 10000000:01000000:2.0:1786400293.615926:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786400293.615962:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000003b6062a9/0x49554f35ff0a4e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400293.615986:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000003b6062a9/0x49554f35ff0a4e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400293.615995:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000003b6062a9/0x49554f35ff0a4e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400293.616012:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000007de80c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392892800:0@lo:101: 00000100:00100000:2.0:1786400293.616056:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400293.616108:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000087033377 going to sleep for 11 seconds 00000100:00100000:1.0:1786400293.616250:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392892800 00000100:00100000:1.0:1786400293.616256:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392892800 00000100:00100000:1.0:1786400293.616298:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786400293.616306:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d2a3a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+5:5796:x1873176392892800:12345-0@lo:101: 00010000:00010000:1.0:1786400293.616327:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400293.616340:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4e1c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.616361:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.616371:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c6685c81/0x49554f35ff0a4e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.616378:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c6685c81, rc 0) 00000100:00100000:1.0:1786400293.616422:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d2a3a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+6:5796:x1873176392892800:12345-0@lo:101: Request processed in 117us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400293.616428:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400293.616502:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000007de80c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392892800:0@lo:101: 00010000:00010000:3.0:1786400293.616513:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000003b6062a9/0x49554f35ff0a4e1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.616520:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000003b6062a9/0x49554f35ff0a4e1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400293.616565:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392892928:0@lo:501: 00000100:00100000:3.0:1786400293.616592:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400293.616613:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026ea524e going to sleep for 11 seconds 00000100:00100000:1.0:1786400293.616668:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392892928 00000100:00100000:1.0:1786400293.616672:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392892928 00000100:00100000:1.0:1786400293.616702:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786400293.616707:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000154bf3cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+6:5796:x1873176392892928:12345-0@lo:501: 00000100:00100000:1.0:1786400293.616948:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000154bf3cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+6:5796:x1873176392892928:12345-0@lo:501: Request processed in 240us (356us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786400293.616955:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400293.617048:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392892928:0@lo:501: 10000000:01000000:3.0:1786400293.617073:0:5796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786400293.617090:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 000000003b6062a9/0x49554f35ff0a4e1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.617098:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 000000003b6062a9/0x49554f35ff0a4e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400293.617105:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9373910fb800 10000000:01000000:3.0:1786400293.617109:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786400293.617112:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9373910fb800 10000000:01000000:3.0:1786400293.617115:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1786400293.617117:0:5796:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9373910fb800 from 1 10000000:01000000:3.0:1786400293.617120:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1786400293.617137:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000003c6a5e45/0x49554f35ff0a4e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.617144:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000003c6a5e45/0x49554f35ff0a4e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.617163:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000003c6a5e45/0x49554f35ff0a4e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400293.617175:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893056:0@lo:101: 00000100:00100000:3.0:1786400293.617201:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400293.617220:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026ea524e going to sleep for 11 seconds 00000100:00100000:1.0:1786400293.617343:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392893056 00000100:00100000:1.0:1786400293.617348:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392893056 00000100:00100000:1.0:1786400293.617378:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400293.617383:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b05a12fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+6:5796:x1873176392893056:12345-0@lo:101: 00010000:00010000:1.0:1786400293.617390:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400293.617400:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d328548/0x49554f35ff0a4e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4e2a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.617425:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d328548/0x49554f35ff0a4e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4e2a expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.617431:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d328548/0x49554f35ff0a4e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e2a expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400293.617438:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d328548, rc 0) 00000100:00100000:1.0:1786400293.617466:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b05a12fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+7:5796:x1873176392893056:12345-0@lo:101: Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400293.617471:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400293.617592:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893056:0@lo:101: 00010000:00010000:3.0:1786400293.617602:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000003c6a5e45/0x49554f35ff0a4e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.617609:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000003c6a5e45/0x49554f35ff0a4e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400293.617620:0:5796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1786400293.617633:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 000000003c6a5e45/0x49554f35ff0a4e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.617639:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 000000003c6a5e45/0x49554f35ff0a4e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400293.617645:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1786400293.617649:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786400293.617653:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9373910fb800 10000000:01000000:3.0:1786400293.617655:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1786400293.617658:0:5796:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1786400293.617660:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1786400293.617671:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000004f73aa10/0x49554f35ff0a4e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.617683:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000004f73aa10/0x49554f35ff0a4e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.617690:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000004f73aa10/0x49554f35ff0a4e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400293.617701:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893184:0@lo:101: 00000100:00100000:3.0:1786400293.617727:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400293.617856:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026ea524e going to sleep for 11 seconds 00000100:00100000:2.0:1786400293.618106:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392893184 00000100:00100000:2.0:1786400293.618112:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392893184 00000100:00100000:2.0:1786400293.618180:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400293.618187:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034cefd33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+7:5796:x1873176392893184:12345-0@lo:101: 00010000:00010000:2.0:1786400293.618202:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400293.618211:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000365ed905/0x49554f35ff0a4e3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4e38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400293.618225:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000365ed905/0x49554f35ff0a4e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400293.618233:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000365ed905/0x49554f35ff0a4e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400293.618239:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000365ed905, rc 0) 00000100:00100000:2.0:1786400293.618275:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034cefd33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+8:5796:x1873176392893184:12345-0@lo:101: Request processed in 90us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400293.618281:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400293.618340:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893184:0@lo:101: 00010000:00010000:3.0:1786400293.618350:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000004f73aa10/0x49554f35ff0a4e38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400293.618357:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000004f73aa10/0x49554f35ff0a4e38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400293.618400:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893312:0@lo:501: 00000100:00100000:3.0:1786400293.618423:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400293.618497:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026ea524e going to sleep for 11 seconds 00000100:00100000:1.0:1786400293.618578:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392893312 00000100:00100000:1.0:1786400293.618583:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392893312 00000100:00100000:1.0:1786400293.618607:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400293.618612:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000578afa59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+8:5796:x1873176392893312:12345-0@lo:501: 00000100:00100000:1.0:1786400293.618845:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000578afa59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+9:5796:x1873176392893312:12345-0@lo:501: Request processed in 232us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400293.618852:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400293.618922:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893312:0@lo:501: 00000100:00100000:3.0:1786400293.618949:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893440:0@lo:503: 00000100:00100000:3.0:1786400293.618994:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400293.619021:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026ea524e going to sleep for 11 seconds 00000100:00100000:1.0:1786400293.619135:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392893440 00000100:00100000:1.0:1786400293.619140:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392893440 00000100:00100000:1.0:1786400293.619157:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400293.619161:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004557f043 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+9:5796:x1873176392893440:12345-0@lo:503: 00000100:00100000:1.0:1786400293.619303:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004557f043 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+9:5796:x1873176392893440:12345-0@lo:503: Request processed in 141us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400293.619310:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400293.619384:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893440:0@lo:503: 00000100:00100000:3.0:1786400293.619798:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:5840:1873176392893568:0@lo:502: 00000100:00100000:3.0:1786400293.619839:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400293.619859:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a49d7f61 going to sleep for 11 seconds 00000100:00100000:1.0:1786400293.619910:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392893568 00000100:00100000:1.0:1786400293.619915:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392893568 00000100:00100000:1.0:1786400293.619934:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786400293.619945:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ce96f07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+9:5840:x1873176392893568:12345-0@lo:502: 00000100:00100000:1.0:1786400293.620126:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ce96f07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+9:5840:x1873176392893568:12345-0@lo:502: Request processed in 181us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400293.620133:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786400293.620271:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:5840:1873176392893568:0@lo:502: 00000020:01000000:3.0:1786400293.620293:0:5840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400293.620302:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400293.620305:0:5840:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786400293.620309:0:5840:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1786400293.620312:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786400293.620325:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000038116a84) 00000020:00000080:3.0:1786400293.620340:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1786400293.620345:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1786400293.620423:0:5840:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1786400293.620430:0:5840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a4e4d 00000020:00000080:3.0:1786400293.620660:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786400293.620665:0:5840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400293.620668:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400293.620669:0:5840:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786400293.620672:0:5840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400293.620675:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400293.620676:0:5840:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1786400293.620679:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786400293.620686:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000122a1e5) 00000020:00000080:3.0:1786400293.620695:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1786400293.620699:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1786400293.620700:0:5840:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1786400293.620702:0:5840:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1786400293.620708:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786400293.620770:0:5840:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e0d9a48 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1786400293.620790:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a5f188a0) 00000020:00000080:3.0:1786400293.620799:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1786400293.620852:0:5840:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1786400293.620861:0:5840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a4e62 00000020:00000080:3.0:1786400293.620952:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1786400293.620960:0:5840:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1786400293.620965:0:5840:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x49554f35ff0a4e69 00080000:01000000:3.0:1786400293.620982:0:5840:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1786400293.620985:0:5840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a4e70 00080000:10000000:3.0:1786400293.621355:0:5840:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1786400293.621549:0:5840:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1786400293.625626:0:5840:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1786400293.706392:0:5840:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1786400293.706901:0:5840:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1786400293.709775:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1786400293.710161:0:5840:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1786400293.799943:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d3488fb5) 00000020:00000080:3.0:1786400293.804839:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1786400293.804959:0:5840:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1786400293.804978:0:5840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a4e7e 00000020:00000080:3.0:1786400293.805664:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1786400293.808864:0:5840:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400293.890987:0:5840:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400293.928491:0:5840:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400293.957191:0:5840:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:3.0:1786400294.034826:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1786400294.101905:0:5840:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400294.191685:0:5840:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1786400294.303130:0:5840:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x49554f35ff0a4e85 00000020:00000080:3.0:1786400294.305847:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1786400294.305862:0:5840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400294.305873:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400294.305875:0:5840:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1786400294.305878:0:5840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400294.305882:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400294.305883:0:5840:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1786400294.305886:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1786400294.305888:0:5840:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1786400294.305890:0:5840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400294.305893:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400294.305894:0:5840:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1786400294.305912:0:5840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400294.305916:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400294.305918:0:5840:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1786400294.305922:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1786400294.305981:0:5840:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1786400294.306045:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:5840:1873176392893696:0@lo:502: 00000100:00100000:3.0:1786400294.306131:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400294.306197:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 000000003e97e3c5 going to sleep for 11 seconds 00000100:00100000:1.0:1786400294.306268:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392893696 00000100:00100000:1.0:1786400294.306277:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392893696 00000100:00100000:1.0:1786400294.306348:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786400294.306357:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e4adacd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+9:5840:x1873176392893696:12345-0@lo:502: 00000100:00100000:1.0:1786400294.306810:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e4adacd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+9:5840:x1873176392893696:12345-0@lo:502: Request processed in 452us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400294.306819:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786400294.307163:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006cebc42c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:5840:1873176392893696:0@lo:502: 00000020:01000000:0.0:1786400294.307193:0:5840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400294.307199:0:5840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400294.307201:0:5840:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1786400294.307204:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1786400294.308180:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1786400294.308211:0:5796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786400294.308236:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 000000004f73aa10/0x49554f35ff0a4e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.308247:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 000000004f73aa10/0x49554f35ff0a4e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400294.308256:0:5796:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9373910fb800 from 1 10000000:01000000:1.0:1786400294.308259:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786400294.308435:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.308444:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.308454:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400294.308481:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068185848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893824:0@lo:101: 00000100:00100000:1.0:1786400294.308534:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400294.308570:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086478304 going to sleep for 11 seconds 00000100:00100000:0.0:1786400294.308666:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392893824 00000100:00100000:0.0:1786400294.308673:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392893824 00000100:00100000:0.0:1786400294.308707:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786400294.308714:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003800db75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+9:5796:x1873176392893824:12345-0@lo:101: 00010000:00010000:0.0:1786400294.308726:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400294.308761:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.308783:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.308792:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.308802:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000517cacc5, rc 0) 00000100:00100000:0.0:1786400294.308856:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003800db75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+10:5796:x1873176392893824:12345-0@lo:101: Request processed in 142us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400294.308863:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786400294.308996:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068185848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893824:0@lo:101: 00010000:00010000:2.0:1786400294.309010:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400294.309028:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400294.309568:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df2f8ba0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893952:0@lo:256: 00000100:00100000:2.0:1786400294.309608:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400294.309643:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5709e21 going to sleep for 11 seconds 00000100:00100000:3.0:1786400294.309792:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392893952 00000100:00100000:3.0:1786400294.309797:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392893952 00000100:00100000:3.0:1786400294.309828:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786400294.309833:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000932bd342 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+10:5796:x1873176392893952:12345-0@lo:256: 20000000:01000000:3.0:1786400294.309851:0:5811:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1786400294.309856:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1786400294.309929:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000932bd342 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+10:5796:x1873176392893952:12345-0@lo:256: Request processed in 96us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400294.309937:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786400294.310100:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df2f8ba0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392893952:0@lo:256: 10000000:01000000:2.0:1786400294.312461:0:5796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786400294.312494:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400294.312519:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400294.312530:0:5796:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373910fb800 from 1 10000000:01000000:2.0:1786400294.312534:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786400294.312574:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400294.312582:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400294.312592:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400294.312615:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df2f8ba0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894080:0@lo:101: 00000100:00100000:2.0:1786400294.312676:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400294.312717:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5709e21 going to sleep for 11 seconds 00000100:00100000:1.0:1786400294.313548:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392894080 00000100:00100000:1.0:1786400294.313560:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392894080 00000100:00100000:1.0:1786400294.313622:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786400294.313631:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042d099ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+10:5796:x1873176392894080:12345-0@lo:101: 00010000:00010000:1.0:1786400294.313647:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400294.313663:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4e9a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.313688:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.313696:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.313767:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c97d7ff, rc 0) 00000100:00100000:1.0:1786400294.313864:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042d099ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5796:x1873176392894080:12345-0@lo:101: Request processed in 234us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400294.313871:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786400294.314290:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df2f8ba0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894080:0@lo:101: 00010000:00010000:2.0:1786400294.314306:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400294.314314:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400294.314376:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df2f8ba0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894208:0@lo:501: 00000100:00100000:2.0:1786400294.314407:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400294.314484:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5709e21 going to sleep for 11 seconds 00000100:00100000:1.0:1786400294.329028:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392894208 00000100:00100000:1.0:1786400294.329046:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392894208 00000100:00100000:1.0:1786400294.329151:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786400294.329160:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044c53d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5796:x1873176392894208:12345-0@lo:501: 00000100:00100000:1.0:1786400294.329881:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044c53d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5796:x1873176392894208:12345-0@lo:501: Request processed in 721us (15473us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400294.329902:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786400294.330136:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df2f8ba0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894208:0@lo:501: 00000100:00100000:3.0:1786400294.330192:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000833f2242 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894336:0@lo:503: 00000100:00100000:3.0:1786400294.330240:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400294.330280:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 00000000efa9a5c4 going to sleep for 11 seconds 00000100:00100000:0.0:1786400294.331278:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392894336 00000100:00100000:0.0:1786400294.331297:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392894336 00000100:00100000:0.0:1786400294.331361:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400294.331369:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000853cc20c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5796:x1873176392894336:12345-0@lo:503: 00000040:00080000:0.0:1786400294.331423:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786400294.331486:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000853cc20c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5796:x1873176392894336:12345-0@lo:503: Request processed in 119us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400294.331494:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786400294.331754:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000833f2242 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894336:0@lo:503: 00000040:00080000:2.0:1786400294.333301:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1786400294.333506:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1786400294.333523:0:5796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786400294.333546:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.333558:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400294.333601:0:5796:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786400294.333604:0:5796:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9373910fb800 10000000:01000000:1.0:1786400294.333606:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9373910fb800 10000000:01000000:1.0:1786400294.333610:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786400294.333615:0:5796:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373910fb800 from 1 10000000:01000000:1.0:1786400294.333618:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786400294.333645:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 00000000ac905cca/0x49554f35ff0a4ea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.333652:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 00000000ac905cca/0x49554f35ff0a4ea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.333661:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 00000000ac905cca/0x49554f35ff0a4ea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400294.333682:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000af012f0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894464:0@lo:101: 00000100:00100000:1.0:1786400294.333771:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400294.333808:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 00000000366a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400294.333999:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392894464 00000100:00100000:2.0:1786400294.334005:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392894464 00000100:00100000:2.0:1786400294.334058:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786400294.334066:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b20a0326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5796:x1873176392894464:12345-0@lo:101: 00010000:00010000:2.0:1786400294.334080:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400294.334100:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036f60a4d/0x49554f35ff0a4eaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4ea8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400294.334121:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036f60a4d/0x49554f35ff0a4eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400294.334132:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036f60a4d/0x49554f35ff0a4eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400294.334140:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036f60a4d, rc 0) 00000100:00100000:2.0:1786400294.334181:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b20a0326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5796:x1873176392894464:12345-0@lo:101: Request processed in 116us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400294.334187:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786400294.334330:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000af012f0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894464:0@lo:101: 00010000:00010000:1.0:1786400294.334356:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 00000000ac905cca/0x49554f35ff0a4ea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.334364:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 00000000ac905cca/0x49554f35ff0a4ea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400294.334407:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000af012f0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894592:0@lo:501: 00000100:00100000:1.0:1786400294.334433:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400294.334495:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 00000000366a33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400294.338967:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392894592 00000100:00100000:3.0:1786400294.338984:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392894592 00000100:00100000:3.0:1786400294.339066:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400294.339076:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000833db72a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5796:x1873176392894592:12345-0@lo:501: 00000100:00100000:3.0:1786400294.339437:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000833db72a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5796:x1873176392894592:12345-0@lo:501: Request processed in 362us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400294.339446:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786400294.339589:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000af012f0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894592:0@lo:501: 00000100:00100000:1.0:1786400294.339642:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000af012f0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894720:0@lo:503: 00000100:00100000:1.0:1786400294.339694:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400294.339777:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 00000000366a33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400294.340552:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392894720 00000100:00100000:3.0:1786400294.340562:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392894720 00000100:00100000:3.0:1786400294.340610:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786400294.340617:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9124682 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5796:x1873176392894720:12345-0@lo:503: 00000100:00100000:3.0:1786400294.340969:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9124682 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5796:x1873176392894720:12345-0@lo:503: Request processed in 341us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400294.340978:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786400294.341116:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000af012f0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392894720:0@lo:503: 00000100:00100000:3.0:1786400294.341946:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c15a173c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:5845:1873176392894848:0@lo:502: 00000100:00100000:3.0:1786400294.342024:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400294.342062:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0ad2306 going to sleep for 11 seconds 00000100:00100000:1.0:1786400294.342119:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392894848 00000100:00100000:1.0:1786400294.342126:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392894848 00000100:00100000:1.0:1786400294.342164:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786400294.342170:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000477fcc15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5845:x1873176392894848:12345-0@lo:502: 00000100:00100000:1.0:1786400294.342423:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000477fcc15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5845:x1873176392894848:12345-0@lo:502: Request processed in 253us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400294.342431:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786400294.342516:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c15a173c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:5845:1873176392894848:0@lo:502: 00000020:01000004:2.0:1786400294.342576:0:5845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1786400294.342590:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000785428af) 00000020:00000080:2.0:1786400294.342608:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1786400294.342795:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e0d9a48 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1786400294.342799:0:5845:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005e0d9a48 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1786400294.342801:0:5845:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005e0d9a48 4 00010000:00080000:2.0:1786400294.342829:0:5845:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f1cc2d8b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:2.0:1786400294.344438:0:5845:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1786400294.344534:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1786400294.344576:0:5845:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1786400294.344586:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x49554f35ff0a4ebd 00000100:00080000:2.0:1786400294.344595:0:5845:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786400294.344600:0:5845:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f1cc2d8b using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1786400294.344630:0:5845:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f8c93ce0 x1873176392894976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786400294.344650:0:5845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1786400294.346635:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8c93ce0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392894976:0@lo:38: 00000100:00100000:1.0:1786400294.346720:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400294.348825:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392894976 00000100:00100000:2.0:1786400294.348839:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392894976 00000100:00100000:2.0:1786400294.348883:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400294.348891:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af012f0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1873176392894976:12345-0@lo:38: 00000100:00100000:2.0:1786400294.348991:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af012f0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1873176392894976:12345-0@lo:38: Request processed in 100us (2271us total) trans 0 rc -11/-11 00000100:00100000:2.0:1786400294.348999:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400294.349130:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003df655fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:5845:1873176392895104:0@lo:502: 00000100:00100000:2.0:1786400294.349184:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400294.349227:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set 000000000722c923 going to sleep for 11 seconds 00000100:00100000:0.0:1786400294.349453:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392895104 00000100:00100000:0.0:1786400294.349458:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392895104 00000100:00100000:0.0:1786400294.349496:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786400294.349502:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8bdde29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5845:x1873176392895104:12345-0@lo:502: 00000100:00100000:0.0:1786400294.349714:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8bdde29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5845:x1873176392895104:12345-0@lo:502: Request processed in 211us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400294.349722:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786400294.349916:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786400294.349924:0:3314:0:(import.c:65:import_set_state_nolock()) 00000000f1cc2d8b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786400294.349929:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786400294.349942:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8c93ce0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392894976:0@lo:38: 00000100:00100000:2.0:1786400294.353169:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003df655fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:5845:1873176392895104:0@lo:502: 00000040:00080000:2.0:1786400294.353213:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1786400294.353646:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1786400294.353669:0:5796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786400294.353690:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 00000000ac905cca/0x49554f35ff0a4ea8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.353704:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 00000000ac905cca/0x49554f35ff0a4ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786400294.353801:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786400294.353803:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786400294.353804:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400294.353805:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400294.353807:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400294.353808:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400294.353810:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786400294.353811:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786400294.353812:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400294.353813:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400294.353815:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400294.353816:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786400294.353820:0:5796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1786400294.353822:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786400294.353824:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786400294.353825:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400294.353826:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400294.353827:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400294.353828:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400294.353829:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786400294.353830:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786400294.353831:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400294.353832:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400294.353833:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400294.353834:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786400294.353860:0:5796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1786400294.353875:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dee0304b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392895232:0@lo:253: 00000100:00100000:1.0:1786400294.353942:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400294.354003:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set 0000000031b2f362 going to sleep for 11 seconds 00000100:00100000:2.0:1786400294.354441:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392895232 00000100:00100000:2.0:1786400294.354450:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392895232 00000100:00100000:2.0:1786400294.354499:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786400294.354509:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000962fbbd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5796:x1873176392895232:12345-0@lo:253: 20000000:01000000:2.0:1786400294.354537:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1786400294.354551:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786400294.408267:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786400294.408296:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1786400294.408426:0:5832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786400294.408433:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786400294.408461:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.408493:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.408502:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.408546:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400294.408562:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 12 pid: 5810 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400294.408579:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000025824308 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1873176392895360:0@lo:104: 00000100:00100000:1.0:1786400294.408655:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400294.408714:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e03b3dc1 going to sleep for 11 seconds 00000100:00100000:0.0:1786400294.408983:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392895360 00000100:00100000:0.0:1786400294.408992:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392895360 00000100:00100000:0.0:1786400294.409061:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400294.409077:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000236f3aac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5832:x1873176392895360:12345-0@lo:104: 00010000:00010000:0.0:1786400294.409220:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.409296:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786400294.409317:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000236f3aac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5832:x1873176392895360:12345-0@lo:104: Request processed in 241us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400294.409324:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400294.409365:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000025824308 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1873176392895360:0@lo:104: 00010000:00010000:0.0:1786400294.409386:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.409403:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400294.409408:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.409415:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f69d797 already unused, calling callback (00000000517fb24e) 10000000:00010000:0.0:1786400294.409418:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.409425:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400294.409432:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400294.409437:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786400294.409610:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.409618:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400294.409637:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.409643:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: 000000006f69d797/0x49554f35ff0a4e8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.409666:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400294.409668:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400294.409669:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400294.409898:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a7006b35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392895488:0@lo:103: 00000100:00100000:0.0:1786400294.409933:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400294.410041:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392895488 00000100:00100000:0.0:1786400294.410047:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392895488 00010000:00010000:0.0:1786400294.410354:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 13 pid: 5810 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400294.410389:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400294.410395:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ca8d903 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:3316:x1873176392895488:12345-0@lo:103: 00010000:00010000:0.0:1786400294.410407:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400294.410411:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 13 pid: 5810 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410421:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 13 pid: 5810 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410433:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000517cacc5/0x49554f35ff0a4e93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4e8c expref: 13 pid: 5810 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410446:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410452:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786400294.410930:0:5800:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002498438s 00010000:00010000:0.0:1786400294.410946:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410952:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410969:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410975:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410980:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000931229a9 already unused, calling callback (00000000de688fac) 00010000:00010000:0.0:1786400294.410984:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.410990:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.411002:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400294.411011:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400294.411057:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ca8d903 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:3316:x1873176392895488:12345-0@lo:103: Request processed in 662us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400294.411063:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400294.411215:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a7006b35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392895488:0@lo:103: 00010000:00010000:3.0:1786400294.411391:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400294.411401:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400294.411406:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000931229a9/0x49554f35ff0a4ec4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400294.429634:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000962fbbd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5796:x1873176392895232:12345-0@lo:253: Request processed in 75119us (75684us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400294.429678:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786400294.430051:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dee0304b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:5796:1873176392895232:0@lo:253: 10000000:01000000:1.0:1786400294.430067:0:5796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1786400294.430070:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786400294.430072:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786400294.430073:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400294.430074:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400294.430076:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400294.430077:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400294.430078:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786400294.430079:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786400294.430087:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400294.430088:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400294.430090:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400294.430091:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786400294.430108:0:5796:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786400294.436545:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1786400294.437283:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786400294.437573:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1786400294.438306:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786400294.441724:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400294.441991:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400294.443003:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400294.443196:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400294.443383:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400294.443545:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400294.443704:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400294.443893:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1786400294.508127:0:5796:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1786400294.583916:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1786400294.584021:0:5850:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1786400294.584025:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1786400294.584606:0:5851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1786400294.589240:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1786400294.589408:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1786400294.593328:0:5796:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1786400294.593368:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1786400294.594257:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400294.597637:0:5796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1786400294.602939:0:5796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1786400294.606913:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1786400294.607779:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1786400294.608607:0:5796:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1786400294.616671:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1786400294.616855:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1786400294.617005:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1786400294.617165:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1786400294.617295:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1786400294.617441:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1786400294.617577:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1786400294.617722:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1786400294.617899:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1786400294.618061:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1786400294.618224:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1786400294.618372:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1786400294.618545:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1786400294.618707:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1786400294.618886:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1786400294.625556:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1786400294.630301:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1786400294.630459:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1786400294.632386:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1786400294.632593:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1786400294.632791:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1786400294.637517:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1786400294.637665:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1786400294.637848:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1786400294.638034:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1786400294.641672:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1786400294.641905:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1786400294.642236:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1786400294.642370:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1786400294.642529:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1786400294.642667:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1786400294.644389:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1786400294.653402:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1786400294.710675:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1786400294.825034:0:5796:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1786400294.825072:0:5796:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4bd81dbf988 00100000:10000000:1.0:1786400294.825082:0:5796:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1786400294.826172:0:5796:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1786400294.826189:0:5796:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1786400294.826203:0:5796:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1786400294.826228:0:5796:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1786400294.832998:0:5851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1786400294.833090:0:5851:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1786400294.833095:0:5851:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1786400295.071191:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400296.083239:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400297.107038:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400298.133849:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400299.169177:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786400299.411658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1786400299.411666:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786400299.411670:0:36:0:(import.c:65:import_set_state_nolock()) 00000000f1cc2d8b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786400299.411683:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f1cc2d8b using connection 192.168.201.123@tcp/0@lo 00000100:00100000:0.0:1786400299.411704:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007522b266 x1873176392895744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786400299.412411:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a7006b35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392895616:0@lo:400: 00000100:00100000:3.0:1786400299.412480:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400299.412633:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392895616 00000100:00100000:3.0:1786400299.412642:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392895616 00000100:00100000:3.0:1786400299.412685:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786400299.412694:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000232b4b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:3317:x1873176392895616:12345-0@lo:400: 00000100:00100000:1.0:1786400299.413801:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007522b266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392895744:0@lo:38: 00000100:00100000:1.0:1786400299.413900:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400299.413965:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392895744 00000100:00100000:1.0:1786400299.413972:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392895744 00000100:00100000:1.0:1786400299.414002:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400299.414007:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dee0304b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1873176392895744:12345-0@lo:38: 00010000:00080000:1.0:1786400299.414033:0:5818:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1786400299.414075:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x49554f35ff0a4ecb 00000004:00100000:1.0:1786400299.414114:0:5818:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1786400299.414284:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000232b4b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:3317:x1873176392895616:12345-0@lo:400: Request processed in 1590us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400299.414295:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1786400299.414369:0:5818:0:(import.c:65:import_set_state_nolock()) 000000009639f2cc : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400299.414499:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dee0304b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873176392895744:12345-0@lo:38: Request processed in 491us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400299.414507:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400299.414863:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a7006b35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392895616:0@lo:400: 00010000:00080000:3.0:1786400299.415017:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007522b266 x1873176392895744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786400299.415031:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1786400299.415038:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1786400299.415043:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786400299.415045:0:3314:0:(import.c:65:import_set_state_nolock()) 00000000f1cc2d8b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786400299.415051:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007522b266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392895744:0@lo:38: 00010000:00010000:1.0:1786400300.180004:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400300.373514:0:6095:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1786400300.952890:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786400300.952899:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9373910fb800 from 3 10000000:01000000:0.0:1786400300.952905:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786400300.952956:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 00000000cf1e1933/0x49554f35ff0a4ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400300.952969:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 00000000cf1e1933/0x49554f35ff0a4ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400300.952980:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 00000000cf1e1933/0x49554f35ff0a4ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400300.953007:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d687c1a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392895872:0@lo:101: 00000100:00100000:0.0:1786400300.953085:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400300.953133:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 00000000851d4bb5 going to sleep for 11 seconds 00000100:00100000:2.0:1786400300.953204:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392895872 00000100:00100000:2.0:1786400300.953212:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392895872 00000100:00100000:2.0:1786400300.953271:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786400300.953279:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ac047fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5813:x1873176392895872:12345-0@lo:101: 00010000:00010000:2.0:1786400300.953294:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400300.953309:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cacc1c9d/0x49554f35ff0a4ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4ed2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400300.953333:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cacc1c9d/0x49554f35ff0a4ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400300.953344:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cacc1c9d/0x49554f35ff0a4ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400300.953353:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cacc1c9d, rc 0) 00000100:00100000:2.0:1786400300.953393:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ac047fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392895872:12345-0@lo:101: Request processed in 115us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400300.953401:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786400300.953501:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d687c1a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392895872:0@lo:101: 00010000:00010000:0.0:1786400300.953580:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 00000000cf1e1933/0x49554f35ff0a4ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400300.953589:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 00000000cf1e1933/0x49554f35ff0a4ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400300.953642:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d687c1a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392896000:0@lo:256: 00000100:00100000:0.0:1786400300.953677:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400300.954916:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 00000000851d4bb5 going to sleep for 11 seconds 00000100:00100000:2.0:1786400300.966493:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392896000 00000100:00100000:2.0:1786400300.966513:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392896000 00000100:00100000:2.0:1786400300.966575:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786400300.966585:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000080feefd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392896000:12345-0@lo:256: 20000000:01000000:2.0:1786400300.966613:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786400300.966633:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786400300.966640:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1786400300.966785:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000080feefd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392896000:12345-0@lo:256: Request processed in 201us (13107us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400300.966794:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786400300.968251:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d687c1a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392896000:0@lo:256: 10000000:01000000:1.0:1786400300.968319:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786400300.968328:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 00000000cf1e1933/0x49554f35ff0a4ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400300.968338:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 00000000cf1e1933/0x49554f35ff0a4ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400301.203086:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400302.230109:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400303.252920:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400304.276335:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400304.531186:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400304.531213:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6610586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392896128:0@lo:400: 00000100:00100000:0.0:1786400304.531811:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400304.531968:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007a2cbdf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392896256:0@lo:400: 00000100:00100000:0.0:1786400304.532003:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400304.532047:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392896256 00000100:00100000:0.0:1786400304.532055:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392896256 00000100:00100000:0.0:1786400304.532105:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400304.532125:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5da4665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392896256:12345-0@lo:400: 00000100:00100000:0.0:1786400304.532177:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5da4665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392896256:12345-0@lo:400: Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400304.532185:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1786400304.532226:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007a2cbdf6 x1873176392896256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400304.532240:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007a2cbdf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392896256:0@lo:400: 00000100:00100000:3.0:1786400304.537275:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392896128 00000100:00100000:3.0:1786400304.537303:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392896128 00000100:00100000:3.0:1786400304.537366:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400304.537376:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dd35b7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:3317:x1873176392896128:12345-0@lo:400: 00000100:00100000:3.0:1786400304.537488:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dd35b7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:3317:x1873176392896128:12345-0@lo:400: Request processed in 114us (6202us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400304.537496:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786400304.537723:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6610586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392896128:0@lo:400: 00010000:00010000:2.0:1786400305.300174:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786400305.512329:0:6296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe01fa43b0 00000020:00000080:2.0:1786400305.512347:0:6296:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1786400305.512353:0:6296:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1786400305.512361:0:6296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe01fa6640 20000000:00000080:2.0:1786400305.512369:0:6296:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9373b44fdc00 uarg=0000000000000000 20000000:01000000:2.0:1786400305.512412:0:6296:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1786400305.512420:0:6296:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1786400305.512424:0:6296:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1786400305.513165:0:6296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1786400305.513180:0:6296:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1786400305.516502:0:6296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786400305.516776:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1786400305.516829:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1786400305.516874:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1786400305.516890:0:6296:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786400305.516909:0:6296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400305.516926:0:6296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400305.516933:0:6296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400305.516973:0:6296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400305.517001:0:6296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 11 pid: 5809 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400305.517015:0:6296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003df655fe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6296:1873176392896384:0@lo:104: 00000100:00100000:2.0:1786400305.517076:0:6296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400305.517125:0:6296:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ed104fdc going to sleep for 11 seconds 00000100:00100000:3.0:1786400305.517298:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392896384 00000100:00100000:3.0:1786400305.517306:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392896384 00000100:00100000:3.0:1786400305.517352:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400305.517360:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002da7cc5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:6296:x1873176392896384:12345-0@lo:104: 00010000:00010000:3.0:1786400305.517371:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400305.517429:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400305.517433:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002da7cc5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:6296:x1873176392896384:12345-0@lo:104: Request processed in 74us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400305.517440:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786400305.517545:0:6296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003df655fe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6296:1873176392896384:0@lo:104: 00010000:00010000:0.0:1786400305.517562:0:6296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.517998:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400305.518004:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.518010:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9de9d05 already unused, calling callback (00000000517fb24e) 10000000:00010000:1.0:1786400305.518013:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.518020:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400305.518038:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400305.518043:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786400305.518071:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.518076:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400305.518092:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.518097:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: 00000000b9de9d05/0x49554f35ff0a4e9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4ea1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.518113:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400305.518114:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400305.518116:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400305.518878:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000721b4dbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392896512:0@lo:103: 00000100:00100000:1.0:1786400305.518939:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400305.519227:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392896512 00000100:00100000:1.0:1786400305.519235:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392896512 00010000:00010000:1.0:1786400305.519259:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 12 pid: 5809 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400305.519285:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400305.519292:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000397d9516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:3316:x1873176392896512:12345-0@lo:103: 00010000:00010000:1.0:1786400305.519303:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400305.519306:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 12 pid: 5809 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519325:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 12 pid: 5809 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519339:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c97d7ff/0x49554f35ff0a4ea1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4e9a expref: 12 pid: 5809 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519351:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519358:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519372:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519379:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519384:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519390:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519395:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee0f0ca6 already unused, calling callback (00000000de688fac) 00010000:00010000:1.0:1786400305.519400:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519407:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519430:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400305.519439:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400305.519473:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000397d9516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:3316:x1873176392896512:12345-0@lo:103: Request processed in 181us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400305.519480:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400305.519515:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000721b4dbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392896512:0@lo:103: 00010000:00010000:0.0:1786400305.520165:0:6296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400305.520175:0:6296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400305.520193:0:6296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee0f0ca6/0x49554f35ff0a4ee0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400306.328965:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400307.354127:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400308.371782:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786400308.374462:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786400308.374473:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373910fb800 from 1 10000000:01000000:2.0:1786400308.374479:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786400308.374535:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 00000000e6f90f0a/0x49554f35ff0a4ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400308.375319:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 00000000e6f90f0a/0x49554f35ff0a4ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400308.375336:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 00000000e6f90f0a/0x49554f35ff0a4ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400308.375363:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005fa8e330 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392896640:0@lo:101: 00000100:00100000:2.0:1786400308.375440:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400308.375501:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 00000000258c0b71 going to sleep for 11 seconds 00000100:00100000:0.0:1786400308.375702:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392896640 00000100:00100000:0.0:1786400308.375711:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392896640 00000100:00100000:0.0:1786400308.376955:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786400308.376968:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000307ecd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+11:5813:x1873176392896640:12345-0@lo:101: 00010000:00010000:0.0:1786400308.376984:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400308.377004:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000585d11dd/0x49554f35ff0a4eee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4ee7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400308.377033:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000585d11dd/0x49554f35ff0a4eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400308.377044:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000585d11dd/0x49554f35ff0a4eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400308.377053:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000585d11dd, rc 0) 00000100:00100000:0.0:1786400308.377130:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000307ecd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392896640:12345-0@lo:101: Request processed in 165us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400308.377137:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786400308.377244:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005fa8e330 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392896640:0@lo:101: 00010000:00010000:2.0:1786400308.377263:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 00000000e6f90f0a/0x49554f35ff0a4ee7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400308.377273:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 00000000e6f90f0a/0x49554f35ff0a4ee7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400308.377351:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005fa8e330 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392896768:0@lo:501: 00000100:00100000:2.0:1786400308.377381:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400308.380300:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 00000000258c0b71 going to sleep for 11 seconds 00000100:00100000:1.0:1786400308.380459:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392896768 00000100:00100000:1.0:1786400308.380469:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392896768 00000100:00100000:1.0:1786400308.380523:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786400308.380532:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023ebf852 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392896768:12345-0@lo:501: 00000100:00100000:1.0:1786400308.380949:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023ebf852 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392896768:12345-0@lo:501: Request processed in 417us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400308.380959:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786400308.381280:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005fa8e330 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392896768:0@lo:501: 00000100:00100000:2.0:1786400308.381331:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005fa8e330 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392896896:0@lo:503: 00000100:00100000:2.0:1786400308.381378:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400308.381394:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 00000000258c0b71 going to sleep for 11 seconds 00000100:00100000:1.0:1786400308.381512:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392896896 00000100:00100000:1.0:1786400308.381517:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392896896 00000100:00100000:1.0:1786400308.381541:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786400308.381547:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028ceac48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392896896:12345-0@lo:503: 00000100:00100000:1.0:1786400308.381711:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028ceac48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392896896:12345-0@lo:503: Request processed in 164us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400308.381728:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786400308.381966:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005fa8e330 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392896896:0@lo:503: 00000100:00100000:2.0:1786400308.382198:0:6383:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005fa8e330 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6383:1873176392897024:0@lo:502: 00000100:00100000:2.0:1786400308.382248:0:6383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400308.382268:0:6383:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bd7a2945 going to sleep for 11 seconds 00000100:00100000:1.0:1786400308.382364:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392897024 00000100:00100000:1.0:1786400308.382369:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392897024 00000100:00100000:1.0:1786400308.382388:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786400308.382394:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008baf7fef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6383:x1873176392897024:12345-0@lo:502: 00000100:00100000:1.0:1786400308.382525:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008baf7fef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6383:x1873176392897024:12345-0@lo:502: Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400308.382533:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786400308.383845:0:6383:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005fa8e330 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6383:1873176392897024:0@lo:502: 00000020:01000000:2.0:1786400308.383885:0:6383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400308.383898:0:6383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400308.383901:0:6383:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786400308.383908:0:6383:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373910fb800 00000020:00000080:2.0:1786400308.383910:0:6383:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786400308.383962:0:6383:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6383:1873176392897152:0@lo:502: 00000100:00100000:2.0:1786400308.384018:0:6383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400308.384056:0:6383:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8180 going to sleep for 11 seconds 00000100:00100000:1.0:1786400308.384342:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392897152 00000100:00100000:1.0:1786400308.384348:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392897152 00000100:00100000:1.0:1786400308.384382:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786400308.384390:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6383:x1873176392897152:12345-0@lo:502: 00000100:00100000:1.0:1786400308.384576:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6383:x1873176392897152:12345-0@lo:502: Request processed in 185us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400308.384583:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786400308.386532:0:6383:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6383:1873176392897152:0@lo:502: 00000020:01000000:2.0:1786400308.386992:0:6383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400308.387004:0:6383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400308.387007:0:6383:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1786400308.387020:0:6383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1786400308.392018:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1786400308.392059:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786400308.392074:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400308.392088:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400309.395002:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400309.651094:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400309.651144:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400309.651165:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392897408:0@lo:400: 00000100:00100000:1.0:1786400309.651229:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400309.651303:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392897408 00000100:00100000:1.0:1786400309.651312:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392897408 00000100:00100000:1.0:1786400309.651365:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400309.651374:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392897408:12345-0@lo:400: 00000100:00100000:1.0:1786400309.651426:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392897408:12345-0@lo:400: Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400309.651433:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1786400309.651471:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff937388c65180 x1873176392897408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400309.651485:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392897408:0@lo:400: 00000100:00100000:2.0:1786400309.655467:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392897280:0@lo:400: 00000100:00100000:2.0:1786400309.655553:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400309.655621:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392897280 00000100:00100000:2.0:1786400309.655629:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392897280 00000100:00100000:2.0:1786400309.655676:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786400309.655686:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:3318:x1873176392897280:12345-0@lo:400: 00000100:00100000:2.0:1786400309.656006:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:3318:x1873176392897280:12345-0@lo:400: Request processed in 320us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400309.656015:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786400309.658557:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392897280:0@lo:400: 00010000:00010000:1.0:1786400310.420013:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400311.443019:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786400311.832517:0:6620:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786400311.832521:0:6620:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1786400311.832672:0:6620:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9373b7b4b000 00000020:01000004:2.0:1786400311.832688:0:6620:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1786400311.832700:0:6620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786400311.833301:0:6620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff937386efcd40) 00000020:00000080:2.0:1786400311.833318:0:6620:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1786400311.876649:0:6620:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1786400311.880886:0:6620:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1786400311.946450:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1786400311.962476:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786400311.962525:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786400311.962588:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786400311.962630:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786400311.963401:0:6620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1786400311.963415:0:6620:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786400311.963426:0:6620:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x49554f35ff0a4efc 00000020:01000004:3.0:1786400311.963435:0:6620:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1786400311.963457:0:6620:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786400311.963460:0:6620:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786400311.963466:0:6620:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1786400311.963471:0:6620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1786400311.963482:0:6620:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9373b7b5b380) 00000020:00000080:3.0:1786400311.963495:0:6620:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1786400311.966512:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400311.966956:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1786400311.966963:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1786400311.971102:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1786400311.971115:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1786400311.971520:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1786400311.971525:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1786400311.973522:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400311.974159:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1786400311.974170:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1786400311.978157:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1786400311.978170:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1786400312.016288:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786400312.017601:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1786400312.017610:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1786400312.043409:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1786400312.043429:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1786400312.049902:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1786400312.049920:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1786400312.075473:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400312.077024:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1786400312.077037:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1786400312.078384:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1786400312.078396:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1786400312.252375:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400312.252580:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1786400312.252586:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1786400312.261251:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1786400312.261268:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1786400312.261857:0:6620:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1786400312.261883:0:6620:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1786400312.261891:0:6620:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1786400312.310041:0:6620:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1786400312.310087:0:6620:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.123@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1786400312.310092:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1786400312.310094:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786400312.310095:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400312.310097:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400312.310098:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400312.310100:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400312.310102:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400312.310105:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786400312.310107:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786400312.310108:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400312.310110:0:6620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786400312.310114:0:6620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1786400312.310117:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786400312.310118:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786400312.310120:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400312.310121:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400312.310122:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400312.310123:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400312.310124:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400312.310125:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786400312.310126:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786400312.310127:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400312.310128:0:6620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786400312.310159:0:6620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1786400312.310176:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392897536:0@lo:253: 00000100:00100000:0.0:1786400312.310244:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400312.310294:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373908bb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.310555:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392897536 00000100:00100000:2.0:1786400312.310562:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392897536 00000100:00100000:2.0:1786400312.310615:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786400312.310625:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392897536:12345-0@lo:253: 20000000:01000000:2.0:1786400312.310672:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1786400312.310676:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1786400312.310681:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1786400312.310689:0:5810:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1786400312.311548:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786400312.311815:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1786400312.311830:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1786400312.311870:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1786400312.311878:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1786400312.311908:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1786400312.311959:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1786400312.312342:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1786400312.312361:0:5810:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.123@tcp 20000000:01000000:2.0:1786400312.312363:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:2.0:1786400312.312397:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1786400312.312405:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1786400312.312453:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1786400312.312461:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:2.0:1786400312.312495:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1786400312.312504:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1786400312.312538:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1786400312.312589:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1786400312.313385:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1786400312.313404:0:5810:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.123@tcp 20000000:01000000:2.0:1786400312.313406:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:2.0:1786400312.313440:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1786400312.313447:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1786400312.313474:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1786400312.313481:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:2.0:1786400312.313577:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1786400312.313587:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1786400312.313622:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1786400312.321433:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1786400312.321481:0:5810:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1786400312.321484:0:5810:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1786400312.321488:0:5810:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1786400312.321504:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786400312.321506:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1786400312.321554:0:5810:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1786400312.321557:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786400312.331479:0:6635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1786400312.331589:0:6635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1786400312.331671:0:6635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1786400312.332157:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1786400312.332200:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1786400312.332257:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1786400312.332272:0:5810:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1786400312.332274:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1786400312.347997:0:6636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1786400312.348347:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1786400312.348399:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1786400312.348476:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1786400312.348490:0:5810:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1786400312.348493:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786400312.349443:0:6637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1786400312.349498:0:6637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1786400312.349547:0:6637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1786400312.349990:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1786400312.350034:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1786400312.350070:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1786400312.350086:0:5810:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1786400312.350088:0:5810:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1786400312.350098:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786400312.350119:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.350137:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.350153:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a4e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.350160:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.350168:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.350206:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.350220:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4eaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 12 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400312.350234:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392897664:0@lo:104: 00000100:00100000:1.0:1786400312.350295:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400312.350349:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a4e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.350357:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a4e3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 12 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400312.350365:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392897792:0@lo:104: 00000100:00100000:1.0:1786400312.350385:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400312.350418:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.350425:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4e23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 12 pid: 5810 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400312.350440:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392897920:0@lo:104: 00000100:00100000:1.0:1786400312.350461:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400312.350471:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738d7bd840 going to sleep for 11 seconds 00000100:00100000:3.0:1786400312.350536:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392897664 00000100:00100000:3.0:1786400312.350543:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392897664 00000100:00100000:3.0:1786400312.350583:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392897792 00000100:00100000:3.0:1786400312.350587:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392897792 00000100:00100000:3.0:1786400312.350597:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392897920 00000100:00100000:3.0:1786400312.350599:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392897920 00000100:00100000:3.0:1786400312.350611:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400312.350618:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+5:5810:x1873176392897664:12345-0@lo:104: 00010000:00010000:3.0:1786400312.350630:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a4ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.350716:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400312.350723:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+5:5810:x1873176392897664:12345-0@lo:104: Request processed in 106us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400312.350731:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400312.350776:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400312.350783:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+4:5810:x1873176392897792:12345-0@lo:104: 00010000:00010000:3.0:1786400312.350791:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.350823:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786400312.350828:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+4:5810:x1873176392897792:12345-0@lo:104: Request processed in 46us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400312.350834:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400312.350848:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400312.350854:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5810:x1873176392897920:12345-0@lo:104: 00010000:00010000:3.0:1786400312.350861:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373c21fc200/0x49554f35ff0a4e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.350887:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1786400312.350899:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5810:x1873176392897920:12345-0@lo:104: Request processed in 46us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400312.350904:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1786400312.350919:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786400312.350924:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a4ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.350931:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4200 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400312.350935:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a4ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.350943:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a4ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400312.350950:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a4ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400312.350956:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786400312.350982:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a4ea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.350988:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400312.351003:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a4ea8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351010:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a4ea8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4eaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351022:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786400312.351025:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351038:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400312.351041:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351047:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400312.351052:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400312.351056:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786400312.351068:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4e38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351074:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400312.351078:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4e38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351084:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4e38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e3f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351093:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400312.351096:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c21fc200/0x49554f35ff0a4e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351101:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fc200 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400312.351104:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fc200/0x49554f35ff0a4e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351120:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c21fc200/0x49554f35ff0a4e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400312.351126:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fc200/0x49554f35ff0a4e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400312.351131:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786400312.351144:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373c21fc200/0x49554f35ff0a4e1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351150:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400312.351163:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c21fc200/0x49554f35ff0a4e1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351169:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c21fc200/0x49554f35ff0a4e1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4e23 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351183:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400312.351184:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400312.351186:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400312.351191:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400312.351207:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392898048:0@lo:103: 00000100:00100000:3.0:1786400312.351233:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.351261:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400312.351267:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392898176:0@lo:103: 00000100:00100000:3.0:1786400312.351286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.351328:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392898304:0@lo:103: 00000100:00100000:3.0:1786400312.351351:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.351392:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392898048 00000100:00100000:3.0:1786400312.351396:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392898048 00010000:00010000:3.0:1786400312.351413:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4eaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 13 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400312.351426:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392898176 00000100:00100000:3.0:1786400312.351428:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392898176 00010000:00010000:3.0:1786400312.351437:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a4e3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 14 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400312.351447:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392898304 00000100:00100000:3.0:1786400312.351449:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392898304 00010000:00010000:3.0:1786400312.351457:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4e23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 15 pid: 5810 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400312.351468:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400312.351474:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:3315:x1873176392898048:12345-0@lo:103: 00010000:00010000:3.0:1786400312.351483:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400312.351488:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4eaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 15 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351496:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4eaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 15 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351509:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400312.351535:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:3315:x1873176392898048:12345-0@lo:103: Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400312.351541:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400312.351552:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400312.351558:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:3315:x1873176392898176:12345-0@lo:103: 00010000:00010000:3.0:1786400312.351564:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400312.351574:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a4e3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 14 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351581:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a4e3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 14 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351590:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400312.351611:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:3315:x1873176392898176:12345-0@lo:103: Request processed in 54us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400312.351617:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400312.351631:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400312.351636:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:3317:x1873176392898304:12345-0@lo:103: 00010000:00010000:3.0:1786400312.351654:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400312.351660:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4e23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 13 pid: 5810 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351667:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4e23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 13 pid: 5810 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351677:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351684:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351696:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351702:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351708:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351719:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351724:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5000 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:3.0:1786400312.351728:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351759:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351769:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.351778:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400312.351807:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:3317:x1873176392898304:12345-0@lo:103: Request processed in 170us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400312.351812:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400312.351846:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392898304:0@lo:103: 00000100:00100000:3.0:1786400312.351871:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392898176:0@lo:103: 00000100:00100000:3.0:1786400312.351878:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392898048:0@lo:103: 00010000:00010000:1.0:1786400312.352378:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4eaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4ea8 expref: 12 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400312.352391:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392897664:0@lo:104: 00010000:00010000:1.0:1786400312.352401:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a4e3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4e38 expref: 11 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400312.352408:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392897792:0@lo:104: 00010000:00010000:1.0:1786400312.352416:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4e1c expref: 10 pid: 5810 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400312.352423:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392897920:0@lo:104: 00010000:00010000:1.0:1786400312.352440:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.352448:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.352454:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.352460:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f5000/0x49554f35ff0a4f0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786400312.352473:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1786400312.444274:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+9:6620:x1873176392897536:12345-0@lo:253: Request processed in 133640us (134019us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400312.444290:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786400312.444683:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392897536:0@lo:253: 10000000:01000000:1.0:1786400312.444708:0:6620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786400312.444713:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786400312.444714:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786400312.444716:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400312.444717:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1786400312.444719:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400312.444720:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400312.444722:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400312.444723:0:6620:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1786400312.444725:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400312.444726:0:6620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1786400312.447834:0:6620:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9373b7b4b000 from lustre-OST0000 10000000:01000000:1.0:1786400312.447871:0:6620:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1786400312.447875:0:6620:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1786400312.447883:0:6620:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9373a0c50000 local copy 10000000:01000000:1.0:1786400312.447888:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786400312.447931:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.447943:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.447953:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400312.447976:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392898432:0@lo:101: 00000100:00100000:1.0:1786400312.448041:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400312.448107:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738d7bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.448209:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392898432 00000100:00100000:2.0:1786400312.448218:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392898432 00000100:00100000:2.0:1786400312.448277:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786400312.448286:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+9:6620:x1873176392898432:12345-0@lo:101: 00010000:00010000:2.0:1786400312.448299:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400312.448312:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a4f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4f11 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.448335:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a4f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4f11 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.448345:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a4f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f11 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.448354:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fda00, rc 0) 00000100:00100000:2.0:1786400312.448393:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+10:6620:x1873176392898432:12345-0@lo:101: Request processed in 108us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.448400:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786400312.448543:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392898432:0@lo:101: 00010000:00010000:0.0:1786400312.448561:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400312.448571:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400312.448720:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392898560:0@lo:501: 00000100:00100000:0.0:1786400312.448783:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400312.448805:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373908bbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.448922:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392898560 00000100:00100000:2.0:1786400312.448926:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392898560 00000100:00100000:2.0:1786400312.448955:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786400312.448962:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+10:6620:x1873176392898560:12345-0@lo:501: 00000100:00100000:2.0:1786400312.449170:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+10:6620:x1873176392898560:12345-0@lo:501: Request processed in 208us (386us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400312.449177:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786400312.449253:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392898560:0@lo:501: 10000000:01000000:3.0:1786400312.449266:0:6620:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786400312.449294:0:6620:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786400312.449299:0:6620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.449319:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.449327:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.449351:0:6620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1786400312.449372:0:6620:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9373b7b4b000 10000000:01000000:3.0:1786400312.449377:0:6620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786400312.449382:0:6620:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9373a0c50000 10000000:01000000:3.0:1786400312.449384:0:6620:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1786400312.449388:0:6620:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9373a0c50000 from 1 10000000:01000000:3.0:1786400312.449390:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1786400312.449409:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.449417:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.449424:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400312.449436:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392898688:0@lo:101: 00000100:00100000:3.0:1786400312.449462:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.449474:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8900 going to sleep for 11 seconds 00010000:00010000:2.0:1786400312.449529:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400312.449535:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.449542:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5000 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400312.449546:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.449560:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400312.449568:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400312.449574:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400312.449593:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.449599:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400312.449622:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.449629:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a4f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x49554f35ff0a4f18 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.449654:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400312.449655:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400312.449657:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400312.449667:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392898688 00000100:00100000:2.0:1786400312.449671:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392898688 00000100:00100000:2.0:1786400312.449689:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786400312.449695:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+10:6620:x1873176392898688:12345-0@lo:101: 00010000:00010000:2.0:1786400312.449714:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400312.449725:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fcc00/0x49554f35ff0a4f26 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4f1f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.449775:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fcc00/0x49554f35ff0a4f26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4f1f expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.449791:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fcc00/0x49554f35ff0a4f26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f1f expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.449798:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fcc00, rc 0) 00000100:00100000:2.0:1786400312.449826:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392898688:12345-0@lo:101: Request processed in 131us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.449832:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786400312.450015:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392898816:0@lo:103: 00000100:00100000:3.0:1786400312.450044:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.450105:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392898688:0@lo:101: 00010000:00010000:3.0:1786400312.450122:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f26 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.450131:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4f26 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400312.450153:0:6620:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1786400312.450172:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f26 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.450181:0:6620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f26 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400312.450187:0:6620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1786400312.450191:0:6620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786400312.450196:0:6620:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1786400312.450198:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786400312.450211:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.450218:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.450225:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400312.450237:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392898944:0@lo:101: 00000100:00100000:3.0:1786400312.450260:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.450272:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400312.450332:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392898816 00000100:00100000:1.0:1786400312.450336:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392898816 00000100:00100000:1.0:1786400312.450378:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400312.450386:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:3318:x1873176392898816:12345-0@lo:103: 00010000:00010000:1.0:1786400312.450401:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400312.450414:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a4f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a4f11 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.450426:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400312.450456:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+10:3318:x1873176392898816:12345-0@lo:103: Request processed in 71us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400312.450462:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400312.450525:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392898944 00000100:00100000:0.0:1786400312.450529:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392898944 00000100:00100000:0.0:1786400312.450561:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786400312.450567:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+10:6620:x1873176392898944:12345-0@lo:101: 00010000:00010000:0.0:1786400312.450576:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400312.450585:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4f2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400312.450609:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400312.450617:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400312.450623:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031600, rc 0) 00000100:00100000:0.0:1786400312.450661:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392898944:12345-0@lo:101: Request processed in 93us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400312.450667:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786400312.450858:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392898816:0@lo:103: 00000100:00100000:3.0:1786400312.450891:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392898944:0@lo:101: 00010000:00010000:3.0:1786400312.450901:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.450908:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400312.450983:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899072:0@lo:501: 00000100:00100000:3.0:1786400312.451008:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.451037:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.451118:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392899072 00000100:00100000:2.0:1786400312.451123:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392899072 00000100:00100000:2.0:1786400312.451155:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786400312.451162:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899072:12345-0@lo:501: 00000100:00100000:2.0:1786400312.451374:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899072:12345-0@lo:501: Request processed in 212us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.451381:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786400312.452263:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899072:0@lo:501: 00000100:00100000:3.0:1786400312.452306:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899200:0@lo:503: 00000100:00100000:3.0:1786400312.452353:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.452387:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.452843:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392899200 00000100:00100000:2.0:1786400312.452851:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392899200 00000100:00100000:2.0:1786400312.452926:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786400312.452936:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899200:12345-0@lo:503: 00000100:00100000:2.0:1786400312.453115:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899200:12345-0@lo:503: Request processed in 180us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.453121:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1786400312.453188:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899200:0@lo:503: 00000040:00080000:3.0:1786400312.453437:0:6620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786400312.453509:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899328:0@lo:502: 00000100:00100000:3.0:1786400312.453543:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.460917:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400312.463137:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392899328 00000100:00100000:1.0:1786400312.463151:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392899328 00000100:00100000:1.0:1786400312.463214:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786400312.463224:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899328:12345-0@lo:502: 00000100:00100000:1.0:1786400312.464671:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899328:12345-0@lo:502: Request processed in 1442us (11121us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400312.464683:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786400312.464875:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899328:0@lo:502: 00000040:00080000:3.0:1786400312.465173:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1786400312.465232:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1786400312.465265:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1786400312.465321:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1786400312.465360:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1786400312.465408:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1786400312.465448:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899456:0@lo:502: 00000100:00100000:3.0:1786400312.465517:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.465556:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400312.465826:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392899456 00000100:00100000:1.0:1786400312.465832:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392899456 00000100:00100000:1.0:1786400312.465867:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786400312.465874:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899456:12345-0@lo:502: 00000100:00100000:1.0:1786400312.466071:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899456:12345-0@lo:502: Request processed in 195us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400312.466078:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786400312.466325:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899456:0@lo:502: 00000040:00080000:3.0:1786400312.466427:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1786400312.466439:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:3.0:1786400312.466975:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1786400312.467391:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786400312.467399:0:6638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1786400312.467405:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400312.467407:0:6638:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1786400312.467414:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786400312.467430:0:6638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff937386efb380) 00000020:00000080:2.0:1786400312.467455:0:6638:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1786400312.467473:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1786400312.467530:0:6638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9373b7b4b000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1786400312.467537:0:6638:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786400312.467543:0:6638:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x49554f35ff0a4f42 00010000:00010000:2.0:1786400312.474431:0:6638:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1786400312.474906:0:6638:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1786400312.479669:0:6638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1786400312.480667:0:6638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1786400312.489130:0:6638:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1786400312.489621:0:6638:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1786400312.492623:0:6638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1786400312.492637:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400312.492652:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400312.492655:0:6638:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1786400312.492658:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400312.492662:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400312.492663:0:6638:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786400312.492666:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786400312.492667:0:6638:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786400312.492732:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400312.492735:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400312.492862:0:6638:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786400312.492867:0:6638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1786400312.493047:0:6620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1786400312.493073:0:6620:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1786400312.493095:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.493104:0:6620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400312.493110:0:6620:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373b7b4b000 from 1 10000000:01000000:3.0:1786400312.493112:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400312.493141:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.493145:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.493153:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400312.493169:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899584:0@lo:101: 00000100:00100000:3.0:1786400312.493220:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.493252:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8000 going to sleep for 11 seconds 00000100:00100000:1.0:1786400312.493682:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392899584 00000100:00100000:1.0:1786400312.493690:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392899584 00000100:00100000:1.0:1786400312.493765:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786400312.493774:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+11:6620:x1873176392899584:12345-0@lo:101: 00010000:00010000:1.0:1786400312.493787:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400312.493806:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4f49 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.493830:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.493840:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400312.493849:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373994f5a00, rc 0) 00000100:00100000:1.0:1786400312.493893:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392899584:12345-0@lo:101: Request processed in 121us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400312.493900:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786400312.494125:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899584:0@lo:101: 00010000:00010000:0.0:1786400312.494138:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400312.494149:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400312.494227:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899712:0@lo:501: 00000100:00100000:0.0:1786400312.494247:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400312.494264:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373908bbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400312.494346:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392899712 00000100:00100000:1.0:1786400312.494351:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392899712 00000100:00100000:1.0:1786400312.494378:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786400312.494386:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392899712:12345-0@lo:501: 00000100:00100000:1.0:1786400312.494619:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392899712:12345-0@lo:501: Request processed in 233us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400312.494625:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786400312.494790:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899712:0@lo:501: 00000100:00100000:3.0:1786400312.494813:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899840:0@lo:503: 00000100:00100000:3.0:1786400312.494841:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.494858:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400312.494898:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392899840 00000100:00100000:1.0:1786400312.494901:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392899840 00000100:00100000:1.0:1786400312.494943:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786400312.494948:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392899840:12345-0@lo:503: 00000100:00100000:1.0:1786400312.495054:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392899840:12345-0@lo:503: Request processed in 105us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400312.495058:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786400312.497024:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899840:0@lo:503: 00000040:00080000:1.0:1786400312.497311:0:6620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786400312.497406:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899968:0@lo:502: 00000100:00100000:1.0:1786400312.498175:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400312.498855:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b049ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400312.500557:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392899968 00000100:00100000:3.0:1786400312.500569:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392899968 00000100:00100000:3.0:1786400312.500675:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786400312.500686:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392899968:12345-0@lo:502: 00000100:00100000:3.0:1786400312.500964:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392899968:12345-0@lo:502: Request processed in 279us (2790us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400312.500973:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786400312.503624:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392899968:0@lo:502: 00000040:00080000:1.0:1786400312.504276:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1786400312.504339:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1786400312.504379:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900096:0@lo:502: 00000100:00100000:1.0:1786400312.504448:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400312.508010:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b049ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400312.509578:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392900096 00000100:00100000:3.0:1786400312.509590:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392900096 00000100:00100000:2.0:1786400312.509759:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786400312.509767:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392900096:12345-0@lo:502: 00000100:00100000:2.0:1786400312.509983:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392900096:12345-0@lo:502: Request processed in 217us (5535us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.509989:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786400312.510119:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900096:0@lo:502: 00000040:00080000:3.0:1786400312.510238:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1786400312.510255:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1786400312.510837:0:6642:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400312.510845:0:6642:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400312.510846:0:6642:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1786400312.510851:0:6642:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373b7b4b000 00000020:00000080:3.0:1786400312.510853:0:6642:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1786400312.510864:0:6642:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400312.510866:0:6642:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400312.510867:0:6642:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1786400312.510868:0:6642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1786400312.510952:0:6620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1786400312.510966:0:6620:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400312.510984:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.510992:0:6620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400312.511021:0:6620:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786400312.511024:0:6620:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9373b7b4b000 10000000:01000000:2.0:1786400312.511026:0:6620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9373b7b4b000 10000000:01000000:2.0:1786400312.511028:0:6620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786400312.511032:0:6620:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373b7b4b000 from 1 10000000:01000000:2.0:1786400312.511034:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786400312.511075:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.511081:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.511090:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400312.511104:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900224:0@lo:101: 00000100:00100000:2.0:1786400312.511136:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400312.511158:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390808c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.511169:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392900224 00000100:00100000:2.0:1786400312.511172:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392900224 00000100:00100000:2.0:1786400312.511188:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786400312.511192:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392900224:12345-0@lo:101: 00010000:00010000:2.0:1786400312.511198:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400312.511207:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4f57 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.511221:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.511226:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.511232:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fc400, rc 0) 00000100:00100000:2.0:1786400312.511258:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900224:12345-0@lo:101: Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.511263:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786400312.511288:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900224:0@lo:101: 00010000:00010000:2.0:1786400312.511299:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.511316:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400312.511375:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900352:0@lo:501: 00000100:00100000:2.0:1786400312.511398:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400312.511405:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390808c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.511423:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392900352 00000100:00100000:2.0:1786400312.511427:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392900352 00000100:00100000:2.0:1786400312.511442:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786400312.511447:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900352:12345-0@lo:501: 00000100:00100000:2.0:1786400312.511612:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900352:12345-0@lo:501: Request processed in 164us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.511619:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786400312.511650:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900352:0@lo:501: 00000100:00100000:2.0:1786400312.511674:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900480:0@lo:503: 00000100:00100000:2.0:1786400312.511720:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400312.511728:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390808c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.511766:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392900480 00000100:00100000:2.0:1786400312.511770:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392900480 00000100:00100000:2.0:1786400312.511785:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786400312.511789:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900480:12345-0@lo:503: 00000100:00100000:2.0:1786400312.511883:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900480:12345-0@lo:503: Request processed in 93us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.511887:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786400312.511908:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900480:0@lo:503: 00000040:00080000:2.0:1786400312.512079:0:6620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786400312.512112:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900608:0@lo:502: 00000100:00100000:2.0:1786400312.512134:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400312.512140:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738783b900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.512152:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392900608 00000100:00100000:2.0:1786400312.512154:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392900608 00000100:00100000:2.0:1786400312.512165:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786400312.512168:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900608:12345-0@lo:502: 00000100:00100000:2.0:1786400312.512276:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900608:12345-0@lo:502: Request processed in 106us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.512283:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786400312.512310:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900608:0@lo:502: 00000040:00080000:2.0:1786400312.512524:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1786400312.512568:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1786400312.512604:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1786400312.512679:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1786400312.512717:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1786400312.512786:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1786400312.512808:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1786400312.512825:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1786400312.512847:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1786400312.512865:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1786400312.512881:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1786400312.512903:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1786400312.512920:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1786400312.512936:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1786400312.512969:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1786400312.512990:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1786400312.513007:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1786400312.513050:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1786400312.513071:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1786400312.513099:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1786400312.513124:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1786400312.513142:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1786400312.513158:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1786400312.513180:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1786400312.513197:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1786400312.513213:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1786400312.513236:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1786400312.513268:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1786400312.513294:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900736:0@lo:502: 00000100:00100000:2.0:1786400312.513335:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400312.513348:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738783b900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400312.513377:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392900736 00000100:00100000:2.0:1786400312.513381:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392900736 00000100:00100000:2.0:1786400312.513401:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786400312.513407:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900736:12345-0@lo:502: 00000100:00100000:2.0:1786400312.513546:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392900736:12345-0@lo:502: Request processed in 139us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.513550:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786400312.513577:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392900736:0@lo:502: 00000040:00080000:2.0:1786400312.513616:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1786400312.513621:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1786400312.514907:0:6643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1786400312.514921:0:6643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9373b9c04d40) 00000020:00000080:0.0:1786400312.514938:0:6643:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1786400312.515068:0:6643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9373b7b4b000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1786400312.515071:0:6643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9373b7b4b000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1786400312.515073:0:6643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373b7b4b000 3 00010000:00080000:0.0:1786400312.515106:0:6643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373a99dd800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.123@tcp at head 00010000:00010000:0.0:1786400312.518072:0:6643:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1786400312.518183:0:6643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1786400312.518215:0:6643:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786400312.518227:0:6643:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x49554f35ff0a4f6c 00000100:00080000:0.0:1786400312.518238:0:6643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786400312.518244:0:6643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9373a99dd800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:0.0:1786400312.518284:0:6643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937388c66300 x1873176392900864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786400312.518357:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1873176392900864:0@lo:38: 00000100:00100000:3.0:1786400312.518467:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400312.519304:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392900864 00000100:00100000:0.0:1786400312.519314:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392900864 00000100:00100000:0.0:1786400312.519359:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400312.519368:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1873176392900864:12345-0@lo:38: 00010000:00080000:0.0:1786400312.519395:0:5818:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:0.0:1786400312.519441:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x49554f35ff0a4f73 00000004:00100000:0.0:1786400312.519567:0:5818:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786400312.519596:0:5818:0:(import.c:65:import_set_state_nolock()) ffff9373b7b4c000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1786400312.521333:0:6643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1786400312.523255:0:6643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1786400312.526666:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873176392900864:12345-0@lo:38: Request processed in 7289us (8189us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400312.526681:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400312.526800:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400312.526811:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392900992:0@lo:400: 00000100:00100000:0.0:1786400312.526855:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400312.526888:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392900992 00000100:00100000:0.0:1786400312.526893:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392900992 00000100:00100000:0.0:1786400312.526920:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400312.526925:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392900992:12345-0@lo:400: 00000100:00100000:0.0:1786400312.526958:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392900992:12345-0@lo:400: Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400312.526963:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1786400312.526987:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff937388c66680 x1873176392900992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400312.526996:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392900992:0@lo:400: 00010000:00080000:3.0:1786400312.527138:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff937388c66300 x1873176392900864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400312.527154:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786400312.527162:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1786400312.527168:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1786400312.527171:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786400312.527173:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373a99dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786400312.527178:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1873176392900864:0@lo:38: 00000020:01000000:3.0:1786400312.527195:0:6620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1786400312.527219:0:6620:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786400312.527236:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.527247:0:6620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1786400312.527292:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1786400312.527294:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786400312.527296:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400312.527297:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400312.527299:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400312.527300:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400312.527301:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400312.527302:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400312.527304:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400312.527306:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400312.527307:0:6620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786400312.527310:0:6620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1786400312.527312:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786400312.527314:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786400312.527315:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400312.527316:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400312.527317:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400312.527318:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400312.527323:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400312.527324:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400312.527325:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400312.527326:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400312.527327:0:6620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786400312.527340:0:6620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1786400312.527351:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392901120:0@lo:253: 00000100:00100000:3.0:1786400312.527381:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.527404:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373916d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400312.527508:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392901120 00000100:00100000:0.0:1786400312.527511:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392901120 00000100:00100000:0.0:1786400312.527614:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786400312.527621:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6620:x1873176392901120:12345-0@lo:253: 20000000:01000000:0.0:1786400312.527648:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786400312.527661:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786400312.561818:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786400312.561866:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1786400312.561990:0:5832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786400312.561994:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786400312.562014:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.562030:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a4ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.562035:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.562068:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a4ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400312.562080:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a4ed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 13 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400312.562100:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c71880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1873176392901248:0@lo:104: 00000100:00100000:3.0:1786400312.562163:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400312.562260:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392901248 00000100:00100000:2.0:1786400312.562267:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392901248 00000100:00100000:2.0:1786400312.562308:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400312.562317:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5832:x1873176392901248:12345-0@lo:104: 00010000:00010000:2.0:1786400312.562331:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a4ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.562410:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786400312.562417:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5832:x1873176392901248:12345-0@lo:104: Request processed in 101us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.562425:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1786400312.562445:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400312.562451:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a4ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.562469:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400312.562473:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a4ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.562482:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a4ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400312.562489:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a4ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400312.562494:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400312.562521:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a4ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.562528:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400312.562546:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a4ed2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.562554:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a4ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4ed9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.562580:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400312.562582:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400312.562584:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400312.562604:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392901376:0@lo:103: 00000100:00100000:2.0:1786400312.562634:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400312.562855:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10f1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400312.562876:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c71880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1873176392901248:0@lo:104: 00010000:00010000:3.0:1786400312.562892:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400312.564161:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392901376 00000100:00100000:2.0:1786400312.564172:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392901376 00010000:00010000:2.0:1786400312.564201:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a4ed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 14 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400312.564225:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400312.564232:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390776850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:3316:x1873176392901376:12345-0@lo:103: 00010000:00010000:2.0:1786400312.564245:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400312.564250:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a4ed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 14 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564260:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a4ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 14 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564277:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a4ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4ed2 expref: 14 pid: 5809 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564294:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564301:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786400312.564317:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002498438s 00010000:00010000:2.0:1786400312.564332:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564339:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564346:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564353:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564359:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762c00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400312.564363:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564370:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564385:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564395:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400312.564446:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390776850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:3316:x1873176392901376:12345-0@lo:103: Request processed in 215us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400312.564451:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400312.564624:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392901376:0@lo:103: 00010000:00010000:2.0:1786400312.564653:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564660:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400312.564672:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399762c00/0x49554f35ff0a4f7a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400312.576394:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:6620:x1873176392901120:12345-0@lo:253: Request processed in 48765us (49003us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400312.576568:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:6620:1873176392901120:0@lo:253: 10000000:01000000:3.0:1786400312.576584:0:6620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1786400312.576588:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786400312.576589:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786400312.576591:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400312.576592:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400312.576593:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400312.576595:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400312.576597:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400312.576598:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400312.576600:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400312.576602:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400312.576603:0:6620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1786400312.576617:0:6620:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1786400312.577604:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00080000:10000000:3.0:1786400312.582227:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400312.582437:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400312.582660:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400312.582902:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400312.583129:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400312.583381:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786400312.585018:0:6620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1786400312.886650:0:6620:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1786400312.886658:0:6620:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1786400312.886703:0:6620:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786400312.886807:0:6620:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786400312.886821:0:6620:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1786400312.886853:0:6620:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1786400313.502378:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400314.514930:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786400315.422006:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786400315.422014:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373910fb800 from 21 10000000:01000000:1.0:1786400315.422019:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786400315.422064:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.422076:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.422086:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400315.422110:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392901504:0@lo:101: 00000100:00100000:1.0:1786400315.422175:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400315.422228:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e600 going to sleep for 11 seconds 00000100:00100000:0.0:1786400315.422278:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392901504 00000100:00100000:0.0:1786400315.422286:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392901504 00000100:00100000:0.0:1786400315.422339:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786400315.422348:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392901504:12345-0@lo:101: 00010000:00010000:0.0:1786400315.422364:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400315.422393:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4f81 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400315.422417:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400315.422427:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400315.422437:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030000, rc 0) 00000100:00100000:0.0:1786400315.422487:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392901504:12345-0@lo:101: Request processed in 140us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400315.422494:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786400315.422716:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392901504:0@lo:101: 00010000:00010000:2.0:1786400315.422732:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.422772:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400315.422829:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392901632:0@lo:501: 00000100:00100000:2.0:1786400315.422855:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.422876:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.423089:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392901632 00000100:00100000:1.0:1786400315.423104:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392901632 00000100:00100000:1.0:1786400315.423140:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786400315.423147:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392901632:12345-0@lo:501: 00000100:00100000:1.0:1786400315.423693:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392901632:12345-0@lo:501: Request processed in 544us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.423702:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786400315.423820:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392901632:0@lo:501: 00000100:00100000:2.0:1786400315.423853:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392901760:0@lo:503: 00000100:00100000:2.0:1786400315.423893:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.423916:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.423964:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392901760 00000100:00100000:1.0:1786400315.423969:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392901760 00000100:00100000:1.0:1786400315.424037:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786400315.424045:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392901760:12345-0@lo:503: 00000100:00100000:1.0:1786400315.424309:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392901760:12345-0@lo:503: Request processed in 264us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.424316:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786400315.432706:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392901760:0@lo:503: 00000100:00100000:0.0:1786400315.433617:0:6751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6751:1873176392901888:0@lo:502: 00000100:00100000:0.0:1786400315.433706:0:6751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400315.433800:0:6751:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84480 going to sleep for 11 seconds 00000100:00100000:2.0:1786400315.434133:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392901888 00000100:00100000:2.0:1786400315.434142:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392901888 00000100:00100000:2.0:1786400315.434193:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786400315.434203:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6751:x1873176392901888:12345-0@lo:502: 00000100:00100000:2.0:1786400315.434542:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6751:x1873176392901888:12345-0@lo:502: Request processed in 340us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400315.434560:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786400315.434883:0:6751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6751:1873176392901888:0@lo:502: 00000100:00100000:0.0:1786400315.434940:0:6751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6751:1873176392902016:0@lo:502: 00000100:00100000:0.0:1786400315.434977:0:6751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400315.435020:0:6751:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84480 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.435062:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392902016 00000100:00100000:1.0:1786400315.435067:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392902016 00000100:00100000:1.0:1786400315.435097:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786400315.435105:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6751:x1873176392902016:12345-0@lo:502: 00000100:00100000:1.0:1786400315.435250:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:6751:x1873176392902016:12345-0@lo:502: Request processed in 145us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.435256:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786400315.437521:0:6751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6751:1873176392902016:0@lo:502: 00000040:00080000:0.0:1786400315.437570:0:6751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1786400315.437964:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1786400315.437985:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786400315.437996:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.438008:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400315.438018:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786400315.438020:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9373910fb800 from 4 10000000:01000000:2.0:1786400315.438023:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786400315.438065:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.438073:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.438082:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400315.438100:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902144:0@lo:101: 00000100:00100000:2.0:1786400315.438157:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.438202:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.438262:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392902144 00000100:00100000:1.0:1786400315.438268:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392902144 00000100:00100000:1.0:1786400315.438314:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786400315.438324:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392902144:12345-0@lo:101: 00010000:00010000:1.0:1786400315.438338:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400315.438353:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4f8f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.438396:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.438405:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.438414:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373994f4e00, rc 0) 00000100:00100000:1.0:1786400315.438458:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392902144:12345-0@lo:101: Request processed in 135us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.438464:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1786400315.438671:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902144:0@lo:101: 00010000:00010000:2.0:1786400315.438685:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.438707:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400315.438790:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902272:0@lo:256: 00000100:00100000:2.0:1786400315.438822:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.438836:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.439047:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392902272 00000100:00100000:1.0:1786400315.439052:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392902272 00000100:00100000:1.0:1786400315.439074:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786400315.439081:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392902272:12345-0@lo:256: 20000000:01000000:1.0:1786400315.439095:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1786400315.439110:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1786400315.439113:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1786400315.439188:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392902272:12345-0@lo:256: Request processed in 107us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.439195:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1786400315.439311:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902272:0@lo:256: 10000000:01000000:2.0:1786400315.439351:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786400315.439358:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.439366:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400315.439384:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1786400315.439387:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1786400315.439390:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1786400315.439411:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.439418:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.439425:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400315.439438:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902400:0@lo:101: 00000100:00100000:2.0:1786400315.439470:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.439497:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400315.439544:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392902400 00000100:00100000:0.0:1786400315.439560:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392902400 00000100:00100000:0.0:1786400315.439599:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786400315.439607:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392902400:12345-0@lo:101: 00010000:00010000:0.0:1786400315.439614:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400315.439624:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4f9d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400315.439640:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400315.439649:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400315.439656:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030400, rc 0) 00000100:00100000:0.0:1786400315.439695:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392902400:12345-0@lo:101: Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400315.439701:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1786400315.439925:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902400:0@lo:101: 00010000:00010000:2.0:1786400315.439935:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400315.439943:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400315.439983:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902528:0@lo:501: 00000100:00100000:2.0:1786400315.440007:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.440036:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400315.440080:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392902528 00000100:00100000:0.0:1786400315.440084:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392902528 00000100:00100000:0.0:1786400315.440114:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786400315.440120:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392902528:12345-0@lo:501: 00000100:00100000:0.0:1786400315.440363:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392902528:12345-0@lo:501: Request processed in 242us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400315.440370:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786400315.440665:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902528:0@lo:501: 00000100:00100000:2.0:1786400315.440693:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902656:0@lo:503: 00000100:00100000:2.0:1786400315.440731:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.440778:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.440842:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392902656 00000100:00100000:1.0:1786400315.440846:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392902656 00000100:00100000:1.0:1786400315.440877:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1786400315.440883:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392902656:12345-0@lo:503: 00000100:00100000:1.0:1786400315.441157:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392902656:12345-0@lo:503: Request processed in 273us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.441165:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786400315.441256:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392902656:0@lo:503: 00000100:00100000:2.0:1786400315.448659:0:6752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6752:1873176392902784:0@lo:502: 00000100:00100000:2.0:1786400315.448938:0:6752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.448983:0:6752:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400315.449041:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392902784 00000100:00100000:0.0:1786400315.449049:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392902784 00000100:00100000:0.0:1786400315.449095:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786400315.449104:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:6752:x1873176392902784:12345-0@lo:502: 00000100:00100000:0.0:1786400315.449437:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:6752:x1873176392902784:12345-0@lo:502: Request processed in 333us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400315.449445:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786400315.451543:0:6752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6752:1873176392902784:0@lo:502: 00000020:01000000:2.0:1786400315.451604:0:6752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786400315.451613:0:6752:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1786400315.451621:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400315.451624:0:6752:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1786400315.451630:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1786400315.451639:0:6752:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.123@tcp to nid 0x20000c0a8c97b (192.168.201.123@tcp) 00000020:01000000:2.0:1786400315.451662:0:6752:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1786400315.451665:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786400315.451690:0:6752:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9373b91eb380) 00000020:00000080:2.0:1786400315.451709:0:6752:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1786400315.451716:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1786400315.451824:0:6752:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1786400315.451830:0:6752:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1786400315.451837:0:6752:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a4fb2 00010000:00080000:2.0:1786400315.451865:0:6752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373b78fc000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:2.0:1786400315.452081:0:6752:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:1.0:1786400315.543603:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1786400315.573207:0:6752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1786400315.573232:0:6752:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1786400315.574297:0:6752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786400315.574477:0:6752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786400315.574530:0:6752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1786400315.574604:0:6752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1786400315.577936:0:6761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786400315.577945:0:6761:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1786400315.592599:0:6752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786400315.592617:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786400315.593420:0:6752:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1786400315.593446:0:6752:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a4fb9 00000100:00080000:2.0:1786400315.593457:0:6752:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786400315.593463:0:6752:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9373b78fc000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1786400315.593502:0:6752:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b6ec6300 x1873176392902912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786400315.593530:0:6752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1786400315.593899:0:6752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400315.593905:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400315.593911:0:6752:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1786400315.593915:0:6752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400315.593919:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400315.593920:0:6752:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786400315.593923:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786400315.593925:0:6752:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1786400315.593954:0:6752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6752:1873176392903040:0@lo:502: 00000100:00100000:2.0:1786400315.594028:0:6752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400315.594070:0:6752:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.595920:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392902912:0@lo:8: 00000100:00100000:1.0:1786400315.595988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400315.596053:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392902912 00000100:00100000:1.0:1786400315.596060:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392902912 00000100:00100000:1.0:1786400315.596092:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400315.596112:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1873176392902912:12345-0@lo:8: 00010000:00080000:1.0:1786400315.596141:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:1.0:1786400315.596169:0:6622:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a4fc0 00002000:00100000:1.0:1786400315.596206:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9373bf25f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1786400315.596211:0:6622:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1786400315.596214:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1786400315.596335:0:6622:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1786400315.596506:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786400315.596531:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9373bf259000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400315.596584:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1873176392902912:12345-0@lo:8: Request processed in 471us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.596603:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1786400315.597752:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b6ec6300 x1873176392902912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786400325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400315.597767:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786400315.597775:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1786400315.597784:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1786400315.597789:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1786400315.597792:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b78fc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1786400315.597802:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1786400315.597808:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392902912:0@lo:8: 00000004:00080000:1.0:1786400315.597845:0:6761:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1786400315.597955:0:6761:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237339214860ns, next at 0ns, rc = 0 00000100:00100000:1.0:1786400315.607016:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392903040 00000100:00100000:1.0:1786400315.607031:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392903040 00000100:00100000:1.0:1786400315.607107:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786400315.607118:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:6752:x1873176392903040:12345-0@lo:502: 00000100:00100000:1.0:1786400315.607385:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:6752:x1873176392903040:12345-0@lo:502: Request processed in 268us (13356us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.607393:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786400315.607464:0:6752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:6752:1873176392903040:0@lo:502: 00000020:01000000:1.0:1786400315.607500:0:6752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400315.607507:0:6752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400315.607510:0:6752:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1786400315.607515:0:6752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1786400315.607677:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1786400315.607696:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786400315.607708:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.607719:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400315.607732:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1786400315.607735:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9373a0c50000 from 1 10000000:01000000:1.0:1786400315.607763:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786400315.607791:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.607799:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.607815:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400315.607833:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392903168:0@lo:101: 00000100:00100000:1.0:1786400315.607869:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400315.607891:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738407ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.607908:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392903168 00000100:00100000:1.0:1786400315.607911:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392903168 00000100:00100000:1.0:1786400315.607934:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786400315.607941:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392903168:12345-0@lo:101: 00010000:00010000:1.0:1786400315.607950:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400315.607961:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4fc7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.607981:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.607992:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.608000:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373994f4a00, rc 0) 00000100:00100000:1.0:1786400315.608029:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392903168:12345-0@lo:101: Request processed in 88us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.608035:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786400315.608063:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392903168:0@lo:101: 00010000:00010000:1.0:1786400315.608074:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.608092:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400315.608136:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392903296:0@lo:501: 00000100:00100000:1.0:1786400315.608160:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400315.608172:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738407ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400315.608184:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392903296 00000100:00100000:1.0:1786400315.608188:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392903296 00000100:00100000:1.0:1786400315.608208:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786400315.608215:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392903296:12345-0@lo:501: 00000100:00100000:1.0:1786400315.608413:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392903296:12345-0@lo:501: Request processed in 198us (251us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786400315.608419:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786400315.608448:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392903296:0@lo:501: 10000000:01000000:1.0:1786400315.608471:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786400315.608478:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400315.608485:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400315.616887:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392903424:0@lo:400: 00000100:00100000:0.0:1786400315.616963:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400315.617031:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400315.617039:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392903552:0@lo:400: 00000100:00100000:0.0:1786400315.617066:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400315.617966:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392903424 00000100:00100000:0.0:1786400315.617973:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392903424 00000100:00100000:0.0:1786400315.618011:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392903552 00000100:00100000:0.0:1786400315.618014:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392903552 00000100:00100000:0.0:1786400315.618037:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400315.618044:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392903424:12345-0@lo:400: 00000100:00100000:0.0:1786400315.618103:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392903424:12345-0@lo:400: Request processed in 59us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400315.618110:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400315.618124:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786400315.618130:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392903552:12345-0@lo:400: 00000100:00100000:0.0:1786400315.618150:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392903552:12345-0@lo:400: Request processed in 21us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400315.618156:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1786400315.618171:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786400315.618210:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c67b80 x1873176392903552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400315.618223:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392903552:0@lo:400: 00010000:00080000:0.0:1786400315.618233:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c66680 x1873176392903424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400315.618242:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392903424:0@lo:400: 00000004:00080000:2.0:1786400315.688784:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1786400315.759603:0:6763:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1786400315.759635:0:6763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1873176392903808:0@lo:7: 00000100:00100000:2.0:1786400315.759756:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392903680:0@lo:13: 00000100:00100000:2.0:1786400315.759839:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400315.759963:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392903680 00000100:00100000:3.0:1786400315.759971:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392903680 00000100:00100000:3.0:1786400315.760040:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786400315.760051:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392903680:12345-0@lo:13: 00002000:00000024:3.0:1786400315.760083:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1786400315.760129:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392903680:12345-0@lo:13: Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400315.760136:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786400315.760181:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b75aca80 x1873176392903680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400315.760212:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392903680:0@lo:13: 00000100:00080000:2.0:1786400315.760334:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400315.760416:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400315.760439:0:6763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400315.761960:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392903808 00000100:00100000:3.0:1786400315.761971:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392903808 00000100:00100000:3.0:1786400315.762190:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400315.762201:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1873176392903808:12345-0@lo:7: 00002000:00080000:3.0:1786400315.775084:0:6624:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1786400315.775094:0:6624:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1786400315.775189:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1873176392903808:12345-0@lo:7: Request processed in 12986us (14768us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400315.775200:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1786400315.775484:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b75ad880 x1873176392903808/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786400331 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400315.775500:0:6763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1873176392903808:0@lo:7: 00000004:00080000:1.0:1786400315.775514:0:6763:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1786400315.775566:0:6763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1873176392903936:0@lo:5: 00000100:00100000:1.0:1786400315.775613:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400315.775677:0:6763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400315.775893:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392903936 00000100:00100000:0.0:1786400315.775900:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392903936 00000100:00100000:0.0:1786400315.775936:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400315.775945:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6763:x1873176392903936:12345-0@lo:5: 00002000:00080000:0.0:1786400315.775970:0:6623:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1786400315.775984:0:6623:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1786400315.776235:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6763:x1873176392903936:12345-0@lo:5: Request processed in 290us (621us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1786400315.776243:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1786400315.776280:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b75ad880 x1873176392903936/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400331 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400315.776292:0:6763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1873176392903936:0@lo:5: 00000004:00080000:0.0:1786400315.776301:0:6763:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1786400315.776327:0:6763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1873176392904064:0@lo:700: 00000100:00100000:0.0:1786400315.776354:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400315.776372:0:6763:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400315.776390:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392904064 00000100:00100000:0.0:1786400315.776393:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392904064 00000100:00100000:0.0:1786400315.776419:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400315.776426:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6763:x1873176392904064:12345-0@lo:700: 00000100:00100000:0.0:1786400315.776466:0:6631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6631:1873176392904192:0@lo:700: 00000100:00100000:0.0:1786400315.776495:0:6631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400315.776512:0:6631:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786400315.776535:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392904192 00000100:00100000:0.0:1786400315.776538:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392904192 00000100:00100000:0.0:1786400315.776577:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400315.776583:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6631:x1873176392904192:12345-0@lo:700: 40000000:02000000:1.0:1786400315.848794:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1786400315.859987:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6631:x1873176392904192:12345-0@lo:700: Request processed in 83397us (83484us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400315.860008:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786400315.861468:0:6631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c64000 x1873176392904192/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786400331 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400315.861487:0:6631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6631:1873176392904192:0@lo:700: 40000000:02000000:2.0:1786400315.861500:0:6631:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1786400315.960053:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1786400315.960074:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1786400315.961317:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6763:x1873176392904064:12345-0@lo:700: Request processed in 184884us (184955us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400315.961352:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786400315.961414:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c66680 x1873176392904064/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786400331 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400315.961426:0:6763:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1786400315.961443:0:6763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1873176392904064:0@lo:700: 00000004:02000040:1.0:1786400316.037822:0:6763:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1786400316.055278:0:6763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1873176392904320:0@lo:5: 00000100:00100000:0.0:1786400316.055345:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400316.055394:0:6763:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400316.056906:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392904320 00000100:00100000:2.0:1786400316.056919:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392904320 00000100:00100000:2.0:1786400316.057194:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786400316.057206:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6763:x1873176392904320:12345-0@lo:5: 00002000:00080000:2.0:1786400316.064420:0:6624:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1786400316.064441:0:6624:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1786400316.070569:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1873176392904320:12345-0@lo:5: Request processed in 13360us (15217us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1786400316.070592:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1786400316.073560:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c66300 x1873176392904320/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400332 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400316.073593:0:6763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1873176392904320:0@lo:5: 00000004:00080000:0.0:1786400316.073611:0:6763:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1786400316.569956:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400317.589351:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400318.622213:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400319.636985:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400320.082455:0:6991:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786400320.669551:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400320.919030:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392904448:0@lo:400: 00000100:00100000:3.0:1786400320.919108:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400320.919167:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400320.919174:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392904832:0@lo:400: 00000100:00100000:3.0:1786400320.919203:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400320.919232:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392904704:0@lo:400: 00000100:00100000:3.0:1786400320.919261:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400320.919280:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400320.919286:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392904576:0@lo:400: 00000100:00100000:3.0:1786400320.919364:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400320.919395:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392904448 00000100:00100000:3.0:1786400320.919403:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392904448 00000100:00100000:3.0:1786400320.919449:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786400320.919459:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3316:x1873176392904448:12345-0@lo:400: 00000100:00100000:3.0:1786400320.919523:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3316:x1873176392904448:12345-0@lo:400: Request processed in 65us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400320.919539:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786400320.919580:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392904704 00000100:00100000:3.0:1786400320.919584:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392904704 00000100:00100000:3.0:1786400320.919615:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392904576 00000100:00100000:3.0:1786400320.919618:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392904576 00000100:00100000:3.0:1786400320.920452:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400320.920461:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392904704:12345-0@lo:400: 00000100:00100000:3.0:1786400320.920529:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392904704:12345-0@lo:400: Request processed in 70us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400320.920535:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400320.920550:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400320.920562:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392904576:12345-0@lo:400: 00000100:00100000:3.0:1786400320.920591:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392904576:12345-0@lo:400: Request processed in 29us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400320.920837:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392904832 00000100:00100000:2.0:1786400320.920842:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392904832 00000100:00100000:2.0:1786400320.920880:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400320.920888:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392904832:12345-0@lo:400: 00000100:00100000:2.0:1786400320.920924:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392904832:12345-0@lo:400: Request processed in 38us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400320.920931:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1786400320.920948:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786400320.920953:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400320.920962:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400320.920973:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392904960:0@lo:13: 00000100:00100000:2.0:1786400320.921003:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400320.921038:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392904960 00000100:00100000:2.0:1786400320.921042:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392904960 00000100:00100000:2.0:1786400320.921067:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400320.921074:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392904960:12345-0@lo:13: 00002000:00000024:2.0:1786400320.921100:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400320.921135:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392904960:12345-0@lo:13: Request processed in 62us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400320.921141:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786400320.921200:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b6ec7b80 x1873176392904960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400320.921231:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392904960:0@lo:13: 00000100:00100000:3.0:1786400320.924179:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1786400320.924530:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373a0c71880 x1873176392904576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400320.924545:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392904576:0@lo:400: 00010000:00080000:3.0:1786400320.924561:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373a0c70700 x1873176392904704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400320.924570:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392904704:0@lo:400: 00010000:00080000:3.0:1786400320.924621:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373a0c72a00 x1873176392904832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400320.931547:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392904832:0@lo:400: 00000100:00100000:3.0:1786400320.932248:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392904448:0@lo:400: 00000001:00080000:1.0:1786400321.064726:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1786400321.687024:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400322.707117:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400323.735150:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400324.756007:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400325.782395:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400326.038726:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392905216:0@lo:400: 00000100:00100000:3.0:1786400326.038823:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400326.043154:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400326.043175:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392905088:0@lo:400: 00000100:00100000:3.0:1786400326.043239:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400326.043295:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392905472:0@lo:400: 00000100:00100000:3.0:1786400326.043323:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400326.043343:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400326.043350:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392905344:0@lo:400: 00000100:00100000:3.0:1786400326.043373:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400326.043401:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392905088 00000100:00100000:3.0:1786400326.043420:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392905088 00000100:00100000:2.0:1786400326.043835:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392905472 00000100:00100000:2.0:1786400326.044024:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392905472 00000100:00100000:2.0:1786400326.044080:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400326.044090:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392905472:12345-0@lo:400: 00000100:00100000:2.0:1786400326.044164:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392905472:12345-0@lo:400: Request processed in 76us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400326.044171:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1786400326.044192:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400326.044227:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373a0c71880 x1873176392905472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400326.044237:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1786400326.044254:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392905472:0@lo:400: 00000100:00100000:2.0:1786400326.044297:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400326.044308:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392905600:0@lo:13: 00000100:00100000:2.0:1786400326.044335:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400326.044363:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392905600 00000100:00100000:2.0:1786400326.044366:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392905600 00000100:00100000:2.0:1786400326.044390:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400326.044396:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392905600:12345-0@lo:13: 00002000:00000024:2.0:1786400326.044433:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400326.045119:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392905216 00000100:00100000:1.0:1786400326.045126:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392905216 00000100:00100000:1.0:1786400326.045163:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392905344 00000100:00100000:1.0:1786400326.045166:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392905344 00000100:00100000:1.0:1786400326.045192:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400326.045199:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392905216:12345-0@lo:400: 00000100:00100000:1.0:1786400326.045248:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392905216:12345-0@lo:400: Request processed in 49us (6424us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400326.045253:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400326.045264:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786400326.045270:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392905344:12345-0@lo:400: 00000100:00100000:1.0:1786400326.045301:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392905344:12345-0@lo:400: Request processed in 31us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400326.045322:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786400326.045722:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786400326.045735:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3318:x1873176392905088:12345-0@lo:400: 00000100:00100000:3.0:1786400326.045804:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3318:x1873176392905088:12345-0@lo:400: Request processed in 73us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400326.045810:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786400326.046153:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392905600:12345-0@lo:13: Request processed in 1755us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400326.046161:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1786400326.046197:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786400326.046232:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373a0c70700 x1873176392905344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400326.046247:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392905344:0@lo:400: 00010000:00080000:2.0:1786400326.046286:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b6ec7b80 x1873176392905600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400326.046300:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392905600:0@lo:13: 00000100:00100000:2.0:1786400326.046310:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392905088:0@lo:400: 00010000:00080000:2.0:1786400326.046327:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373a0c72a00 x1873176392905216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400326.046336:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392905216:0@lo:400: 00010000:00010000:2.0:1786400326.803941:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400327.826934:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400328.853601:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400329.876591:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400330.902054:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400331.154887:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400331.154924:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392905728:0@lo:13: 00000100:00100000:2.0:1786400331.154994:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400331.155056:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392905728 00000100:00100000:2.0:1786400331.155064:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392905728 00000100:00100000:2.0:1786400331.155121:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786400331.155130:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392905728:12345-0@lo:13: 00002000:00000024:2.0:1786400331.155168:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400331.155212:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392905728:12345-0@lo:13: Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400331.155219:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1786400331.155250:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400331.155282:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b6ec7b80 x1873176392905728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400331.155299:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392905728:0@lo:13: 00000100:00100000:2.0:1786400331.161586:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392905856:0@lo:400: 00000100:00100000:2.0:1786400331.161667:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400331.161717:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400331.161724:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392905984:0@lo:400: 00000100:00100000:2.0:1786400331.161769:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400331.161807:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392905984 00000100:00100000:2.0:1786400331.161816:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392905984 00000100:00100000:2.0:1786400331.161866:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400331.161875:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392905984:12345-0@lo:400: 00000100:00100000:2.0:1786400331.161946:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392905984:12345-0@lo:400: Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400331.161953:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1786400331.161991:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b6ec4e00 x1873176392905984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400331.162004:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392905984:0@lo:400: 00000100:00100000:2.0:1786400331.162026:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392906112:0@lo:400: 00000100:00100000:2.0:1786400331.162049:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400331.163110:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392905856 00000100:00100000:2.0:1786400331.163120:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392905856 00000100:00100000:2.0:1786400331.163158:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786400331.163166:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3315:x1873176392905856:12345-0@lo:400: 00000100:00100000:2.0:1786400331.163226:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3315:x1873176392905856:12345-0@lo:400: Request processed in 61us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400331.163243:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786400331.163295:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392905856:0@lo:400: 00000100:00100000:3.0:1786400331.163541:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392906112 00000100:00100000:3.0:1786400331.163546:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392906112 00000100:00100000:3.0:1786400331.163593:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786400331.163601:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392906112:12345-0@lo:400: 00000100:00100000:3.0:1786400331.163644:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392906112:12345-0@lo:400: Request processed in 45us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400331.163658:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1786400331.163706:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b6ec4a80 x1873176392906112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400331.163718:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392906112:0@lo:400: 00000100:00080000:2.0:1786400331.163934:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786400331.924953:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786400332.668002:0:7520:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786400332.668006:0:7520:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1786400332.668144:0:7520:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9373bf25e800 00000020:01000004:2.0:1786400332.668363:0:7520:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1786400332.668377:0:7520:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1786400332.668391:0:7520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9373b91e99c0) 00000020:00000080:2.0:1786400332.668410:0:7520:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1786400332.739654:0:7520:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1786400332.740761:0:7520:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1786400332.834095:0:7520:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1786400332.844664:0:7520:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786400332.844697:0:7520:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786400332.844785:0:7520:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786400332.844811:0:7520:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786400332.845149:0:7520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1786400332.845161:0:7520:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786400332.845172:0:7520:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x49554f35ff0a4fdc 00000020:01000004:3.0:1786400332.845179:0:7520:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1786400332.845200:0:7520:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786400332.845203:0:7520:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786400332.845209:0:7520:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1786400332.845230:0:7520:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1786400332.845234:0:7520:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1786400332.906825:0:7520:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:1.0:1786400332.906867:0:7520:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.123@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1786400332.906873:0:7520:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1786400332.906875:0:7520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786400332.906876:0:7520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400332.906877:0:7520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400332.906879:0:7520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400332.906880:0:7520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400332.906882:0:7520:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400332.906884:0:7520:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400332.906885:0:7520:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400332.906887:0:7520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400332.906888:0:7520:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786400332.906892:0:7520:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1786400332.906894:0:7520:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786400332.906896:0:7520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786400332.906897:0:7520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400332.906898:0:7520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400332.906899:0:7520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400332.906901:0:7520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400332.906902:0:7520:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400332.908049:0:7520:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400332.908051:0:7520:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400332.908053:0:7520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400332.908054:0:7520:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786400332.908088:0:7520:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1786400332.908110:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392906240:0@lo:253: 00000100:00100000:1.0:1786400332.908191:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400332.908403:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86300 going to sleep for 11 seconds 00000100:00100000:3.0:1786400332.910473:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392906240 00000100:00100000:3.0:1786400332.910488:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392906240 00000100:00100000:3.0:1786400332.910553:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786400332.910563:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:7520:x1873176392906240:12345-0@lo:253: 20000000:01000000:3.0:1786400332.910599:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1786400332.910604:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1786400332.910609:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1786400332.910613:0:5810:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1786400332.912564:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786400332.912850:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1786400332.912871:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1786400332.913113:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1786400332.913123:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1786400332.913154:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1786400332.913203:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1786400332.914157:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1786400332.914182:0:5810:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.123@tcp 20000000:01000000:2.0:1786400332.914184:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:2.0:1786400332.914219:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1786400332.914228:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1786400332.914273:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1786400332.914282:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:2.0:1786400332.914326:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1786400332.914335:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1786400332.914367:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1786400332.914484:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1786400332.919070:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1786400332.919111:0:5810:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.123@tcp 20000000:01000000:2.0:1786400332.919114:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:2.0:1786400332.919156:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1786400332.919164:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1786400332.919198:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1786400332.919205:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:2.0:1786400332.919236:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1786400332.919245:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1786400332.919484:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1786400332.919530:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1786400332.919548:0:5810:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1786400332.919551:0:5810:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1786400332.919557:0:5810:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1786400332.919558:0:5810:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1786400332.919561:0:5810:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1786400332.919573:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1786400332.919575:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1786400332.919611:0:5810:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1786400332.919614:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786400332.931549:0:7522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1786400332.931646:0:7522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1786400332.931713:0:7522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1786400332.932232:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1786400332.932278:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1786400332.932365:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1786400332.932378:0:5810:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1786400332.932381:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1786400332.934942:0:7523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1786400332.935607:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1786400332.935659:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1786400332.935732:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1786400332.936930:0:5810:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1786400332.936935:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00010000:00010000:2.0:1786400332.950278:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1786400332.956376:0:7524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1786400332.956516:0:7524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1786400332.956558:0:7524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1786400332.958381:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1786400332.958447:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1786400332.958538:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1786400332.958556:0:5810:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1786400332.958560:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786400332.968721:0:7525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1786400332.969163:0:7525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1786400332.969252:0:7525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1786400332.979688:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1786400332.980124:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1786400332.980173:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1786400332.980196:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786400332.980217:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980236:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980243:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980251:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980257:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980264:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980271:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980383:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980400:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 16 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400332.980415:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906368:0@lo:104: 00000100:00100000:1.0:1786400332.980498:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400332.980611:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980620:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 16 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400332.980629:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906496:0@lo:104: 00010000:00010000:1.0:1786400332.980657:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980665:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 16 pid: 5811 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400332.980672:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ae300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906624:0@lo:104: 00010000:00010000:1.0:1786400332.980694:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980702:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 16 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400332.980710:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906752:0@lo:104: 00010000:00010000:1.0:1786400332.980733:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400332.980780:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 16 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400332.980788:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906880:0@lo:104: 00000100:00100000:1.0:1786400332.980818:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86900 going to sleep for 11 seconds 00000100:00100000:0.0:1786400332.981105:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786400332.981127:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400332.981189:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400332.981417:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400332.981438:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392906368 00000100:00100000:3.0:1786400332.981446:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392906368 00000100:00100000:3.0:1786400332.981485:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392906496 00000100:00100000:3.0:1786400332.981489:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392906496 00000100:00100000:3.0:1786400332.981499:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392906624 00000100:00100000:3.0:1786400332.981501:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392906624 00000100:00100000:3.0:1786400332.981512:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400332.981520:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390937850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+5:5810:x1873176392906368:12345-0@lo:104: 00010000:00010000:3.0:1786400332.981534:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400332.981604:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400332.981610:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390937850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+5:5810:x1873176392906368:12345-0@lo:104: Request processed in 91us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400332.981617:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400332.981653:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400332.981661:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+4:5810:x1873176392906496:12345-0@lo:104: 00010000:00010000:3.0:1786400332.981676:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400332.981710:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786400332.981715:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+4:5810:x1873176392906496:12345-0@lo:104: Request processed in 56us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400332.981722:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400332.981734:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786400332.981795:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5810:x1873176392906624:12345-0@lo:104: 00010000:00010000:3.0:1786400332.981802:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400332.981828:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1786400332.981832:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5810:x1873176392906624:12345-0@lo:104: Request processed in 40us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400332.981838:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1786400332.981926:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786400332.981934:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.981951:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4400 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400332.981955:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.981972:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400332.981979:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400332.981985:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400332.982025:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982032:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400332.982061:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982069:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f4400/0x49554f35ff0a4fc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982083:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786400332.982087:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982092:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fc800 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400332.982095:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982102:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400332.982108:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400332.982119:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400332.982134:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982139:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400332.982152:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982159:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c21fc800/0x49554f35ff0a4f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fa4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982168:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400332.982171:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982176:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4c00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400332.982179:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982186:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400332.982192:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400332.982197:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400332.982208:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982214:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400332.982226:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982232:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f4c00/0x49554f35ff0a4f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982240:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400332.982242:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400332.982244:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400332.982258:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392907008:0@lo:103: 00000100:00100000:2.0:1786400332.982329:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400332.982376:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392907136:0@lo:103: 00000100:00100000:2.0:1786400332.982399:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400332.982417:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400332.982423:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392907264:0@lo:103: 00000100:00100000:2.0:1786400332.982442:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400332.982470:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392907008 00000100:00100000:2.0:1786400332.982475:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392907008 00010000:00010000:2.0:1786400332.982492:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 17 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400332.982506:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392907136 00000100:00100000:2.0:1786400332.982509:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392907136 00010000:00010000:2.0:1786400332.982518:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 18 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400332.982528:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392907264 00000100:00100000:2.0:1786400332.982530:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392907264 00010000:00010000:2.0:1786400332.982540:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 19 pid: 5811 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400332.982596:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786400332.982602:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392907008:12345-0@lo:103: 00010000:00010000:2.0:1786400332.982613:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400332.982618:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 19 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982627:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 19 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982644:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400332.982672:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392907008:12345-0@lo:103: Request processed in 70us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400332.982678:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786400332.982691:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786400332.982697:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:3315:x1873176392907136:12345-0@lo:103: 00010000:00010000:2.0:1786400332.982704:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400332.982708:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 18 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982717:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 18 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982727:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400332.982776:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:3315:x1873176392907136:12345-0@lo:103: Request processed in 78us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400332.982782:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786400332.982793:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400332.982805:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3315:x1873176392907264:12345-0@lo:103: 00010000:00010000:2.0:1786400332.982812:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400332.982816:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 17 pid: 5811 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982824:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 17 pid: 5811 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.982833:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400332.982854:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3315:x1873176392907264:12345-0@lo:103: Request processed in 50us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400332.982860:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1786400332.982882:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400332.982905:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392907264:0@lo:103: 00000100:00100000:2.0:1786400332.982913:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392907136:0@lo:103: 00000100:00100000:2.0:1786400332.982934:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392907008:0@lo:103: 00010000:00010000:1.0:1786400332.987890:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a4fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4fc7 expref: 16 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400332.987912:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906368:0@lo:104: 00010000:00010000:1.0:1786400332.987922:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380030400/0x49554f35ff0a4fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4f9d expref: 15 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400332.987930:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906496:0@lo:104: 00010000:00010000:1.0:1786400332.987939:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380030000/0x49554f35ff0a4f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4f81 expref: 14 pid: 5811 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400332.987945:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ae300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906624:0@lo:104: 00000100:00100000:0.0:1786400332.988476:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400332.993207:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392906752 00000100:00100000:3.0:1786400332.993231:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392906752 00000100:00100000:3.0:1786400332.993379:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392906880 00000100:00100000:3.0:1786400332.993384:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392906880 00000100:00100000:3.0:1786400332.993404:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786400332.993413:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+4:5810:x1873176392906752:12345-0@lo:104: 00010000:00010000:3.0:1786400332.993437:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400332.993585:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400332.993592:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+4:5810:x1873176392906752:12345-0@lo:104: Request processed in 181us (12174us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400332.993620:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786400332.993642:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786400332.993648:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5810:x1873176392906880:12345-0@lo:104: 00010000:00010000:3.0:1786400332.993657:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400332.993693:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786400332.993698:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5810:x1873176392906880:12345-0@lo:104: Request processed in 51us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400332.993704:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1786400332.993813:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786400332.993822:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.993831:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fd400 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400332.993836:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.993846:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400332.993854:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400332.993869:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400332.994118:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.994127:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400332.994163:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.994171:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a4f57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f5e expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.994184:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400332.994187:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.994194:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762400 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400332.994197:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.994204:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400332.994210:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400332.994215:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400332.994234:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.994240:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400332.994253:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.994259:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a4f2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f34 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.994275:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400332.994276:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400332.994278:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400332.994376:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392907520:0@lo:103: 00000100:00100000:2.0:1786400332.994421:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400332.994462:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400332.994468:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392907392:0@lo:103: 00000100:00100000:2.0:1786400332.994491:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400332.994520:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392907520 00000100:00100000:2.0:1786400332.994525:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392907520 00010000:00010000:2.0:1786400332.994546:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 14 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400332.994566:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392907392 00000100:00100000:2.0:1786400332.994569:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392907392 00010000:00010000:2.0:1786400332.997603:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 15 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400332.997658:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400332.997681:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:3318:x1873176392907520:12345-0@lo:103: 00010000:00010000:2.0:1786400332.997700:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400332.997707:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 15 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.997762:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 15 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.997789:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400332.997869:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:3318:x1873176392907520:12345-0@lo:103: Request processed in 202us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400332.997877:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400332.997898:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786400332.997918:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:3318:x1873176392907392:12345-0@lo:103: 00010000:00010000:2.0:1786400332.997926:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400332.997931:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 14 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.997941:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 14 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.997953:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.997961:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.997977:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.997984:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.997991:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.998005:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.998012:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400332.998017:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.998025:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.998035:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400332.998044:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400332.998071:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:3318:x1873176392907392:12345-0@lo:103: Request processed in 167us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400332.998078:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786400332.998134:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392907392:0@lo:103: 00000100:00100000:2.0:1786400332.998145:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392907520:0@lo:103: 00010000:00010000:2.0:1786400332.998173:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400333.002204:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a4f5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4f57 expref: 13 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400333.002230:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906752:0@lo:104: 00010000:00010000:1.0:1786400333.002248:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380031600/0x49554f35ff0a4f34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4f2d expref: 12 pid: 5809 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400333.002258:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1873176392906880:0@lo:104: 00010000:00010000:1.0:1786400333.002317:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.002328:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.002334:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.002362:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f5800/0x49554f35ff0a4fe3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786400333.002378:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1786400333.087526:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+11:7520:x1873176392906240:12345-0@lo:253: Request processed in 176956us (179326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400333.087543:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786400333.089620:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392906240:0@lo:253: 10000000:01000000:0.0:1786400333.089670:0:7520:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786400333.089674:0:7520:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786400333.089676:0:7520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786400333.089678:0:7520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400333.089682:0:7520:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1786400333.089683:0:7520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400333.089685:0:7520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400333.089686:0:7520:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400333.089688:0:7520:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1786400333.089690:0:7520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400333.089691:0:7520:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786400333.089717:0:7520:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9373bf25e800 from lustre-OST0001 10000000:01000000:0.0:1786400333.089786:0:7520:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1786400333.089790:0:7520:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1786400333.089798:0:7520:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9373a0c50000 local copy 10000000:01000000:0.0:1786400333.089802:0:7520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786400333.089844:0:7520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.089855:0:7520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.089865:0:7520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400333.089885:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392907648:0@lo:101: 00000100:00100000:0.0:1786400333.089962:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.090026:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400333.090803:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392907648 00000100:00100000:2.0:1786400333.090813:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392907648 00000100:00100000:2.0:1786400333.090873:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786400333.090883:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+11:7520:x1873176392907648:12345-0@lo:101: 00010000:00010000:2.0:1786400333.090898:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400333.090920:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fd400/0x49554f35ff0a4ff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4fea expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.090964:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fd400/0x49554f35ff0a4ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4fea expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.090975:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fd400/0x49554f35ff0a4ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4fea expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.090987:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fd400, rc 0) 00000100:00100000:2.0:1786400333.091051:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392907648:12345-0@lo:101: Request processed in 169us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400333.091057:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786400333.091136:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392907648:0@lo:101: 00010000:00010000:1.0:1786400333.091152:0:7520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.091161:0:7520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400333.091298:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392907776:0@lo:501: 00000100:00100000:1.0:1786400333.091330:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400333.091369:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400333.091493:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392907776 00000100:00100000:2.0:1786400333.091498:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392907776 00000100:00100000:2.0:1786400333.091529:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786400333.091535:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392907776:12345-0@lo:501: 00000100:00100000:2.0:1786400333.091771:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392907776:12345-0@lo:501: Request processed in 233us (438us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400333.091778:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786400333.091926:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392907776:0@lo:501: 10000000:01000000:1.0:1786400333.091941:0:7520:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1786400333.091966:0:7520:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1786400333.091973:0:7520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.091981:0:7520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.091988:0:7520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.092017:0:7520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786400333.092043:0:7520:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9373bf25e800 10000000:01000000:1.0:1786400333.092048:0:7520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786400333.092053:0:7520:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1786400333.092055:0:7520:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786400333.092059:0:7520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1786400333.092062:0:7520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1786400333.092079:0:7520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.092086:0:7520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.092093:0:7520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400333.092105:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392907904:0@lo:101: 00000100:00100000:1.0:1786400333.092128:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400333.092144:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86300 going to sleep for 11 seconds 00010000:00010000:2.0:1786400333.092249:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400333.092256:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092264:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031000 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400333.092268:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092276:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400333.092307:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400333.092312:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400333.092329:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092334:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400333.092359:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092366:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937380031000/0x49554f35ff0a4fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49554f35ff0a4ff1 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092379:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400333.092380:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400333.092382:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400333.092391:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392907904 00000100:00100000:2.0:1786400333.092394:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392907904 00000100:00100000:2.0:1786400333.092418:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786400333.092424:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392907904:12345-0@lo:101: 00010000:00010000:2.0:1786400333.092433:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400333.092444:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a4ff8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092463:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092472:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092485:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fc800, rc 0) 00000100:00100000:2.0:1786400333.092513:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392907904:12345-0@lo:101: Request processed in 88us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400333.092518:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786400333.092540:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400333.092549:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392908032:0@lo:103: 00000100:00100000:2.0:1786400333.092573:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400333.092599:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392908032 00000100:00100000:2.0:1786400333.092603:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392908032 00000100:00100000:2.0:1786400333.092628:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400333.092634:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:3316:x1873176392908032:12345-0@lo:103: 00010000:00010000:2.0:1786400333.092641:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400333.092652:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fd400/0x49554f35ff0a4ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a4fea expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.092661:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400333.092684:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:3316:x1873176392908032:12345-0@lo:103: Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400333.092690:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400333.092713:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392908032:0@lo:103: 00000100:00100000:1.0:1786400333.092926:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392907904:0@lo:101: 00010000:00010000:1.0:1786400333.092939:0:7520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.092948:0:7520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400333.093024:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908160:0@lo:501: 00000100:00100000:1.0:1786400333.093072:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400333.093098:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400333.093489:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392908160 00000100:00100000:2.0:1786400333.093494:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392908160 00000100:00100000:2.0:1786400333.093518:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786400333.093524:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908160:12345-0@lo:501: 00000100:00100000:2.0:1786400333.093710:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908160:12345-0@lo:501: Request processed in 185us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400333.093726:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786400333.093903:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908160:0@lo:501: 00000100:00100000:1.0:1786400333.093942:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908288:0@lo:503: 00000100:00100000:1.0:1786400333.093977:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400333.094419:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400333.094508:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392908288 00000100:00100000:2.0:1786400333.094513:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392908288 00000100:00100000:2.0:1786400333.094544:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786400333.094550:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908288:12345-0@lo:503: 00000100:00100000:2.0:1786400333.094691:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908288:12345-0@lo:503: Request processed in 140us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400333.094697:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1786400333.094779:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908288:0@lo:503: 00000040:00080000:1.0:1786400333.095186:0:7520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786400333.095261:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908416:0@lo:502: 00000100:00100000:1.0:1786400333.095384:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400333.095412:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400333.095502:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392908416 00000100:00100000:2.0:1786400333.095509:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392908416 00000100:00100000:2.0:1786400333.095535:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786400333.095542:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908416:12345-0@lo:502: 00000100:00100000:2.0:1786400333.095669:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908416:12345-0@lo:502: Request processed in 127us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400333.095674:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1786400333.095767:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908416:0@lo:502: 00000040:00080000:0.0:1786400333.096220:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1786400333.096268:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1786400333.096308:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1786400333.096372:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1786400333.096411:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1786400333.096459:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1786400333.096487:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908544:0@lo:502: 00000100:00100000:0.0:1786400333.096534:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.096566:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400333.096571:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392908544 00000100:00100000:1.0:1786400333.096575:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392908544 00000100:00100000:1.0:1786400333.096606:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786400333.096613:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908544:12345-0@lo:502: 00000100:00100000:1.0:1786400333.096915:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908544:12345-0@lo:502: Request processed in 301us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400333.096922:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786400333.096972:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908544:0@lo:502: 00000040:00080000:0.0:1786400333.097050:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1786400333.097059:0:7520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1786400333.099926:0:7527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786400333.099943:0:7527:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1786400333.099950:0:7527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400333.099952:0:7527:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1786400333.099957:0:7527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786400333.099971:0:7527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9373b9c03380) 00000020:00000080:0.0:1786400333.099991:0:7527:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1786400333.099995:0:7527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786400333.100042:0:7527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9373bf25e800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1786400333.100050:0:7527:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1786400333.100056:0:7527:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x49554f35ff0a500d 00010000:00010000:1.0:1786400333.118637:0:7527:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1786400333.118994:0:7527:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1786400333.121079:0:7527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1786400333.121408:0:7527:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1786400333.130063:0:7527:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1786400333.131145:0:7527:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1786400333.137328:0:7527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1786400333.137417:0:7527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400333.137424:0:7527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400333.137426:0:7527:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1786400333.137429:0:7527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400333.137433:0:7527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400333.137435:0:7527:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786400333.137438:0:7527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786400333.137440:0:7527:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786400333.137500:0:7527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400333.137502:0:7527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400333.137504:0:7527:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1786400333.137507:0:7527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1786400333.138505:0:7520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1786400333.141044:0:7520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1786400333.141110:0:7520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.141123:0:7520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400333.141131:0:7520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373bf25e800 from 1 10000000:01000000:0.0:1786400333.141133:0:7520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400333.141175:0:7520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.141204:0:7520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.141216:0:7520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400333.141240:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908672:0@lo:101: 00000100:00100000:0.0:1786400333.141318:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400333.143480:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392908672 00000100:00100000:1.0:1786400333.143492:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392908672 00000100:00100000:1.0:1786400333.143554:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786400333.143564:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:7520:x1873176392908672:12345-0@lo:101: 00010000:00010000:1.0:1786400333.143580:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400333.143600:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5014 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.143624:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.143635:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.143643:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373994f4a00, rc 0) 00000100:00100000:1.0:1786400333.143705:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392908672:12345-0@lo:101: Request processed in 142us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400333.143711:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786400333.143852:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400333.143880:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908672:0@lo:101: 00010000:00010000:0.0:1786400333.143898:0:7520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.143908:0:7520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400333.144037:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908800:0@lo:501: 00000100:00100000:0.0:1786400333.144071:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.144096:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496300 going to sleep for 11 seconds 00000100:00100000:3.0:1786400333.147889:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392908800 00000100:00100000:3.0:1786400333.147904:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392908800 00000100:00100000:3.0:1786400333.147987:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1786400333.147997:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392908800:12345-0@lo:501: 00000100:00100000:3.0:1786400333.148320:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392908800:12345-0@lo:501: Request processed in 323us (4247us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400333.148328:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1786400333.148456:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908800:0@lo:501: 00000100:00100000:3.0:1786400333.148504:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908928:0@lo:503: 00000100:00100000:3.0:1786400333.148544:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400333.148563:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490540 going to sleep for 11 seconds 00000100:00100000:3.0:1786400333.148576:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392908928 00000100:00100000:3.0:1786400333.148579:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392908928 00000100:00100000:3.0:1786400333.148595:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1786400333.148600:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392908928:12345-0@lo:503: 00000100:00100000:3.0:1786400333.148909:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392908928:12345-0@lo:503: Request processed in 307us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400333.148920:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1786400333.148954:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392908928:0@lo:503: 00000040:00080000:3.0:1786400333.149216:0:7520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786400333.152607:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909056:0@lo:502: 00000100:00100000:3.0:1786400333.152703:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.152832:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392909056 00000100:00100000:0.0:1786400333.152841:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392909056 00000100:00100000:0.0:1786400333.152895:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786400333.152914:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392909056:12345-0@lo:502: 00000100:00100000:0.0:1786400333.153171:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392909056:12345-0@lo:502: Request processed in 266us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400333.153179:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786400333.153337:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490540 going to sleep for 11 seconds 00000100:00100000:3.0:1786400333.153434:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909056:0@lo:502: 00000040:00080000:3.0:1786400333.153728:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1786400333.154126:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1786400333.154165:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909184:0@lo:502: 00000100:00100000:3.0:1786400333.154212:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400333.154236:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490540 going to sleep for 11 seconds 00000100:00100000:0.0:1786400333.154310:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392909184 00000100:00100000:0.0:1786400333.154316:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392909184 00000100:00100000:0.0:1786400333.154428:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1786400333.154437:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392909184:12345-0@lo:502: 00000100:00100000:0.0:1786400333.155472:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392909184:12345-0@lo:502: Request processed in 1032us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400333.155481:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786400333.158825:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909184:0@lo:502: 00000040:00080000:1.0:1786400333.159195:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1786400333.159213:0:7520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1786400333.168190:0:7531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400333.168207:0:7531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400333.168210:0:7531:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786400333.168217:0:7531:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373bf25e800 00000020:00000080:0.0:1786400333.168220:0:7531:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786400333.168243:0:7531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400333.168247:0:7531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400333.168248:0:7531:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1786400333.168251:0:7531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1786400333.168623:0:7520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1786400333.168653:0:7520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786400333.168712:0:7520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.168726:0:7520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400333.168804:0:7520:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786400333.168808:0:7520:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9373bf25e800 10000000:01000000:1.0:1786400333.168811:0:7520:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9373bf25e800 10000000:01000000:1.0:1786400333.168815:0:7520:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786400333.168821:0:7520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373bf25e800 from 1 10000000:01000000:1.0:1786400333.168824:0:7520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786400333.168867:0:7520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.168876:0:7520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.168889:0:7520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400333.168933:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909312:0@lo:101: 00000100:00100000:1.0:1786400333.169007:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400333.169056:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86000 going to sleep for 11 seconds 00000100:00100000:3.0:1786400333.169130:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392909312 00000100:00100000:3.0:1786400333.169140:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392909312 00000100:00100000:3.0:1786400333.169190:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1786400333.169199:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392909312:12345-0@lo:101: 00010000:00010000:3.0:1786400333.169214:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400333.169231:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5022 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.169255:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.169267:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.169276:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763400, rc 0) 00000100:00100000:3.0:1786400333.169357:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909312:12345-0@lo:101: Request processed in 158us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400333.169367:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786400333.169840:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909312:0@lo:101: 00010000:00010000:1.0:1786400333.169856:0:7520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400333.169875:0:7520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400333.169995:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909440:0@lo:501: 00000100:00100000:1.0:1786400333.170031:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400333.170066:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86000 going to sleep for 11 seconds 00000100:00100000:0.0:1786400333.170196:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392909440 00000100:00100000:0.0:1786400333.170202:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392909440 00000100:00100000:0.0:1786400333.170233:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786400333.170240:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909440:12345-0@lo:501: 00000100:00100000:0.0:1786400333.170562:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909440:12345-0@lo:501: Request processed in 322us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400333.170570:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786400333.170609:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909440:0@lo:501: 00000100:00100000:0.0:1786400333.170634:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909568:0@lo:503: 00000100:00100000:0.0:1786400333.170669:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.170683:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400333.170695:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392909568 00000100:00100000:0.0:1786400333.170703:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392909568 00000100:00100000:0.0:1786400333.170720:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1786400333.170725:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909568:12345-0@lo:503: 00000100:00100000:0.0:1786400333.170885:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909568:12345-0@lo:503: Request processed in 158us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400333.170892:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1786400333.171023:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909568:0@lo:503: 00000040:00080000:0.0:1786400333.171255:0:7520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786400333.171320:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909696:0@lo:502: 00000100:00100000:0.0:1786400333.171561:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.171628:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400333.171879:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392909696 00000100:00100000:1.0:1786400333.171885:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392909696 00000100:00100000:1.0:1786400333.172134:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786400333.172143:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909696:12345-0@lo:502: 00000100:00100000:1.0:1786400333.172460:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909696:12345-0@lo:502: Request processed in 318us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400333.172467:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786400333.172540:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909696:0@lo:502: 00000040:00080000:2.0:1786400333.172825:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1786400333.172878:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1786400333.172929:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1786400333.172980:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1786400333.173022:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1786400333.173070:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1786400333.173108:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1786400333.173140:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1786400333.173189:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1786400333.173225:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1786400333.173259:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1786400333.173317:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1786400333.173379:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1786400333.173412:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1786400333.173461:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1786400333.173492:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1786400333.173517:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1786400333.173566:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1786400333.173597:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1786400333.173623:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1786400333.173675:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1786400333.173706:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1786400333.173732:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1786400333.173805:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1786400333.173840:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1786400333.173874:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1786400333.173921:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1786400333.173957:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1786400333.174005:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1786400333.174053:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1786400333.174091:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1786400333.174126:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1786400333.174158:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1786400333.174205:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1786400333.174243:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1786400333.174310:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1786400333.174349:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1786400333.174396:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909824:0@lo:502: 00000100:00100000:2.0:1786400333.174472:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400333.177686:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a9923780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400333.177817:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392909824 00000100:00100000:0.0:1786400333.177827:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392909824 00000100:00100000:0.0:1786400333.177880:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786400333.177890:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909824:12345-0@lo:502: 00000100:00100000:0.0:1786400333.178210:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392909824:12345-0@lo:502: Request processed in 321us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400333.178218:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1786400333.178583:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392909824:0@lo:502: 00000040:00080000:2.0:1786400333.178703:0:7520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1786400333.178718:0:7520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1786400333.182166:0:7532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1786400333.182185:0:7532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9373b7b599c0) 00000020:00000080:3.0:1786400333.182207:0:7532:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1786400333.182517:0:7532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9373bf25e800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1786400333.182522:0:7532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9373bf25e800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1786400333.182525:0:7532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373bf25e800 3 00010000:00080000:3.0:1786400333.182555:0:7532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373bf7d2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.123@tcp at head 00010000:00010000:3.0:1786400333.188837:0:7532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1786400333.188969:0:7532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1786400333.189012:0:7532:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786400333.189025:0:7532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x49554f35ff0a5037 00000100:00080000:3.0:1786400333.189035:0:7532:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786400333.189042:0:7532:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9373bf7d2000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1786400333.189079:0:7532:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373a0c73b80 x1873176392909952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786400333.189104:0:7532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1786400333.190175:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1873176392909952:0@lo:38: 00000100:00100000:1.0:1786400333.190259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400333.190469:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392910080:0@lo:400: 00000100:00100000:3.0:1786400333.190502:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400333.190535:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392910208:0@lo:400: 00000100:00100000:3.0:1786400333.190559:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400333.190597:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392909952 00000100:00100000:3.0:1786400333.190607:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392909952 00000100:00100000:3.0:1786400333.190635:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392910080 00000100:00100000:3.0:1786400333.190639:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392910080 00000100:00100000:3.0:1786400333.190661:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392910208 00000100:00100000:3.0:1786400333.190678:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392910208 00000100:00100000:1.0:1786400333.194636:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400333.194662:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392910336:0@lo:400: 00000100:00100000:1.0:1786400333.194735:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.194920:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392910336 00000100:00100000:0.0:1786400333.194930:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392910336 00000100:00100000:3.0:1786400333.195530:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786400333.195543:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392910080:12345-0@lo:400: 00000100:00100000:3.0:1786400333.195628:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392910080:12345-0@lo:400: Request processed in 87us (5124us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400333.195637:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1786400333.195686:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c64e00 x1873176392910080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400333.195700:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392910080:0@lo:400: 00000100:00100000:3.0:1786400333.195767:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400333.195778:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392910208:12345-0@lo:400: 00000100:00100000:3.0:1786400333.195832:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392910208:12345-0@lo:400: Request processed in 56us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400333.195838:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400333.195852:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400333.195859:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1873176392909952:12345-0@lo:38: 00010000:00080000:3.0:1786400333.196572:0:5817:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1786400333.196609:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x49554f35ff0a503e 00000004:00100000:3.0:1786400333.196625:0:5817:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786400333.196664:0:5817:0:(import.c:65:import_set_state_nolock()) ffff937399f15800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786400333.196723:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873176392909952:12345-0@lo:38: Request processed in 862us (6463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400333.196730:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1786400333.196838:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373a0c73b80 x1873176392909952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400333.196848:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786400333.196869:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1786400333.196877:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1786400333.196882:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786400333.196885:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786400333.196892:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1873176392909952:0@lo:38: 00010000:00080000:3.0:1786400333.196928:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c65880 x1873176392910208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400333.197065:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392910208:0@lo:400: 00000040:00080000:3.0:1786400333.197237:0:7532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1786400333.201433:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400333.201450:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392910336:12345-0@lo:400: 00000100:00100000:0.0:1786400333.201556:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392910336:12345-0@lo:400: Request processed in 111us (6820us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400333.201563:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400333.201841:0:7533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7533:1873176392910464:0@lo:901: 00000100:00100000:0.0:1786400333.201889:0:7533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.201935:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392910464 00000100:00100000:0.0:1786400333.201941:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392910464 00000100:00100000:0.0:1786400333.201971:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400333.201978:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7533:x1873176392910464:12345-0@lo:901: 00000100:00100000:0.0:1786400333.202346:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7533:x1873176392910464:12345-0@lo:901: Request processed in 366us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400333.202353:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400333.202376:0:7533:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496d80 going to sleep for 11 seconds 00010000:00080000:0.0:1786400333.202399:0:7533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c64700 x1873176392910464/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1786400349 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400333.202412:0:7533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7533:1873176392910464:0@lo:901: 00010000:00080000:3.0:1786400333.203820:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937388c67100 x1873176392910336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400333.203837:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392910336:0@lo:400: 00000020:01000000:0.0:1786400333.204930:0:7520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1786400333.204966:0:7520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786400333.204987:0:7520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.205000:0:7520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786400333.205059:0:7520:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786400333.205062:0:7520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786400333.205064:0:7520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400333.205065:0:7520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400333.205066:0:7520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400333.205067:0:7520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400333.205069:0:7520:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400333.205070:0:7520:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786400333.205072:0:7520:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786400333.205074:0:7520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400333.205075:0:7520:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786400333.205079:0:7520:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1786400333.205082:0:7520:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786400333.205088:0:7520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786400333.205089:0:7520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400333.205090:0:7520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400333.205091:0:7520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400333.205092:0:7520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400333.205092:0:7520:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400333.205093:0:7520:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786400333.205094:0:7520:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786400333.205095:0:7520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400333.205096:0:7520:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786400333.205132:0:7520:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1786400333.205149:0:7520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392910592:0@lo:253: 00000100:00100000:0.0:1786400333.205220:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.205258:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786400333.205280:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392910592 00000100:00100000:0.0:1786400333.205297:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392910592 00000100:00100000:0.0:1786400333.205410:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1786400333.205420:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7520:x1873176392910592:12345-0@lo:253: 20000000:01000000:0.0:1786400333.205445:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1786400333.205458:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1786400333.206207:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786400333.206214:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1786400333.263115:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786400333.263140:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1786400333.263973:0:5832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786400333.263980:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786400333.264003:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.264024:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.264032:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.264073:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.264086:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 14 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400333.264121:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1873176392910720:0@lo:104: 00000100:00100000:3.0:1786400333.264187:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400333.264247:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490540 going to sleep for 11 seconds 00000100:00100000:2.0:1786400333.264366:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392910720 00000100:00100000:2.0:1786400333.264377:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392910720 00000100:00100000:2.0:1786400333.264436:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786400333.264446:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5832:x1873176392910720:12345-0@lo:104: 00010000:00010000:2.0:1786400333.264458:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400333.264523:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786400333.264529:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:5832:x1873176392910720:12345-0@lo:104: Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400333.264536:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1786400333.264818:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400333.264826:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.264834:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fce00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:0.0:1786400333.264838:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.264846:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400333.264867:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400333.264873:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786400333.264906:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.264913:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400333.264933:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.264941:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c21fce00/0x49554f35ff0a4f8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f96 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.264958:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400333.264960:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400333.264962:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400333.264986:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392910848:0@lo:103: 00000100:00100000:0.0:1786400333.265025:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400333.265070:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392910848 00000100:00100000:0.0:1786400333.265074:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392910848 00010000:00010000:0.0:1786400333.265094:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 15 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400333.265117:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400333.265124:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390774050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:3315:x1873176392910848:12345-0@lo:103: 00010000:00010000:0.0:1786400333.265135:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400333.265140:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 15 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265157:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 15 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265175:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265182:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786400333.265196:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002498438s 00010000:00010000:0.0:1786400333.265201:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265208:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265215:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265222:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265227:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400333.265232:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265238:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265247:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400333.265267:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400333.265308:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390774050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:3315:x1873176392910848:12345-0@lo:103: Request processed in 184us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400333.265315:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400333.265384:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392910848:0@lo:103: 00010000:00010000:3.0:1786400333.265711:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f4e00/0x49554f35ff0a4f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4f8f expref: 14 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400333.265725:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1873176392910720:0@lo:104: 00010000:00010000:3.0:1786400333.265813:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.265824:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.265830:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400333.265836:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399763800/0x49554f35ff0a5045 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400333.275900:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:7520:x1873176392910592:12345-0@lo:253: Request processed in 70469us (70666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400333.275918:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1786400333.276103:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e769e6f-cf99-4814-98f1-5b8d54010374:7520:1873176392910592:0@lo:253: 10000000:01000000:0.0:1786400333.276119:0:7520:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786400333.276123:0:7520:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786400333.276125:0:7520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786400333.276126:0:7520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400333.276127:0:7520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400333.276129:0:7520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400333.276130:0:7520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400333.276132:0:7520:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400333.276134:0:7520:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786400333.276135:0:7520:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786400333.276137:0:7520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400333.276139:0:7520:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1786400333.276158:0:7520:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1786400333.291134:0:7520:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400333.295454:0:7520:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1786400333.295707:0:7520:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400333.297947:0:7520:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1786400333.298262:0:7520:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400333.298531:0:7520:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1786400333.305276:0:7520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1786400333.558122:0:7520:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1786400333.558130:0:7520:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1786400333.558180:0:7520:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786400333.558250:0:7520:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786400333.558269:0:7520:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1786400333.558310:0:7520:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1786400333.971625:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400334.996041:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400336.020310:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400336.276363:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392910976:0@lo:13: 00000100:00100000:1.0:1786400336.276433:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400336.276554:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392910976 00000100:00100000:0.0:1786400336.276561:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392910976 00000100:00100000:0.0:1786400336.276617:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786400336.276627:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392910976:12345-0@lo:13: 00002000:00000024:0.0:1786400336.276659:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400336.276703:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392910976:12345-0@lo:13: Request processed in 78us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400336.276711:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1786400336.276776:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786400336.276807:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c64700 x1873176392910976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400336.276836:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392910976:0@lo:13: 00010000:00010000:0.0:1786400337.045283:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400338.067675:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400338.336523:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392911104:0@lo:400: 00000100:00100000:2.0:1786400338.336609:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400338.336655:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392911616:0@lo:400: 00000100:00100000:2.0:1786400338.336686:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400338.336713:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400338.336719:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392911232:0@lo:400: 00000100:00100000:2.0:1786400338.336764:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400338.342456:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392911104 00000100:00100000:0.0:1786400338.342472:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392911104 00000100:00100000:0.0:1786400338.344671:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1786400338.344694:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:3317:x1873176392911104:12345-0@lo:400: 00000100:00100000:0.0:1786400338.344801:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:3317:x1873176392911104:12345-0@lo:400: Request processed in 118us (8192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400338.344809:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1786400338.344856:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392911488:0@lo:400: 00000100:00100000:0.0:1786400338.344889:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400338.344920:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400338.344926:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392911360:0@lo:400: 00000100:00100000:0.0:1786400338.344945:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400338.344984:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392911488 00000100:00100000:0.0:1786400338.344989:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392911488 00000100:00100000:0.0:1786400338.345025:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400338.345031:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392911488:12345-0@lo:400: 00000100:00100000:0.0:1786400338.345060:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392911488:12345-0@lo:400: Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400338.345066:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400338.345081:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392911616 00000100:00100000:0.0:1786400338.345084:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392911616 00000100:00100000:0.0:1786400338.345098:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392911232 00000100:00100000:0.0:1786400338.345101:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392911232 00000100:00100000:0.0:1786400338.345110:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392911360 00000100:00100000:0.0:1786400338.345112:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392911360 00000100:00100000:0.0:1786400338.345125:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786400338.345131:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392911616:12345-0@lo:400: 00000100:00100000:0.0:1786400338.345158:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392911616:12345-0@lo:400: Request processed in 27us (8471us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400338.345178:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786400338.345189:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400338.345228:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392911232:12345-0@lo:400: 00000100:00100000:0.0:1786400338.345254:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392911232:12345-0@lo:400: Request processed in 60us (8490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400338.345259:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400338.345269:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400338.345274:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392911360:12345-0@lo:400: 00000100:00100000:0.0:1786400338.345293:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392911360:12345-0@lo:400: Request processed in 19us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400338.345298:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1786400338.345311:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400338.345315:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786400338.345339:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b6ec5180 x1873176392911360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400338.345352:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392911360:0@lo:400: 00010000:00080000:0.0:1786400338.345361:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b6ec7480 x1873176392911488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400338.345369:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392911488:0@lo:400: 00010000:00080000:2.0:1786400338.368108:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b6ec5500 x1873176392911232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400338.368127:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392911232:0@lo:400: 00000100:00100000:2.0:1786400338.368140:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392911104:0@lo:400: 00010000:00080000:2.0:1786400338.368152:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b6ec6a00 x1873176392911616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400338.368161:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392911616:0@lo:400: 00010000:00010000:0.0:1786400339.092067:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786400339.858825:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786400339.858834:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373b7b4b000 from 30 10000000:01000000:0.0:1786400339.858840:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786400339.858894:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.858928:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.858941:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400339.858964:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392911744:0@lo:101: 00000100:00100000:0.0:1786400339.859035:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400339.859098:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.859179:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392911744 00000100:00100000:1.0:1786400339.859188:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392911744 00000100:00100000:1.0:1786400339.859240:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1786400339.859251:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392911744:12345-0@lo:101: 00010000:00010000:1.0:1786400339.859265:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400339.859277:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a504c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.859299:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a504c expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.859310:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a504c expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.859319:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373994f5c00, rc 0) 00000100:00100000:1.0:1786400339.859361:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392911744:12345-0@lo:101: Request processed in 113us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.859368:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1786400339.859513:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392911744:0@lo:101: 00010000:00010000:3.0:1786400339.859529:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.859551:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400339.859615:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392911872:0@lo:501: 00000100:00100000:3.0:1786400339.859643:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.859669:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390910840 going to sleep for 11 seconds 00000100:00100000:0.0:1786400339.859803:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392911872 00000100:00100000:0.0:1786400339.859807:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392911872 00000100:00100000:0.0:1786400339.859844:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1786400339.859851:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392911872:12345-0@lo:501: 00000100:00100000:0.0:1786400339.860205:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392911872:12345-0@lo:501: Request processed in 354us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400339.860212:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1786400339.860394:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392911872:0@lo:501: 00000100:00100000:3.0:1786400339.860423:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392912000:0@lo:503: 00000100:00100000:3.0:1786400339.860463:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.860503:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390910840 going to sleep for 11 seconds 00000100:00100000:0.0:1786400339.860810:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392912000 00000100:00100000:0.0:1786400339.860816:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392912000 00000100:00100000:0.0:1786400339.865324:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786400339.865350:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392912000:12345-0@lo:503: 00000100:00100000:0.0:1786400339.865796:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392912000:12345-0@lo:503: Request processed in 458us (5332us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400339.865804:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1786400339.867612:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392912000:0@lo:503: 00000100:00100000:1.0:1786400339.872904:0:7816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7816:1873176392912128:0@lo:502: 00000100:00100000:1.0:1786400339.872987:0:7816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.873024:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392912128 00000100:00100000:1.0:1786400339.873031:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392912128 00000100:00100000:1.0:1786400339.873071:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1786400339.873078:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7816:x1873176392912128:12345-0@lo:502: 00000100:00100000:1.0:1786400339.873392:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7816:x1873176392912128:12345-0@lo:502: Request processed in 313us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.873401:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1786400339.873455:0:7816:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871480 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.873476:0:7816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7816:1873176392912128:0@lo:502: 00000100:00100000:1.0:1786400339.873519:0:7816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7816:1873176392912256:0@lo:502: 00000100:00100000:1.0:1786400339.873549:0:7816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.873569:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392912256 00000100:00100000:1.0:1786400339.873572:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392912256 00000100:00100000:1.0:1786400339.873592:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1786400339.873599:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7816:x1873176392912256:12345-0@lo:502: 00000100:00100000:0.0:1786400339.874120:0:7816:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871480 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.874667:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+14:7816:x1873176392912256:12345-0@lo:502: Request processed in 1065us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.874677:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786400339.874917:0:7816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7816:1873176392912256:0@lo:502: 00000040:00080000:0.0:1786400339.874950:0:7816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1786400339.875217:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1786400339.875241:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786400339.875254:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.875265:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400339.875274:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1786400339.875277:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1786400339.875281:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786400339.875311:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.875318:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.875336:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400339.875352:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392912384:0@lo:101: 00000100:00100000:3.0:1786400339.875386:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.875411:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400339.875462:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392912384 00000100:00100000:0.0:1786400339.875468:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392912384 00000100:00100000:0.0:1786400339.875518:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786400339.875525:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392912384:12345-0@lo:101: 00010000:00010000:0.0:1786400339.875540:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400339.875553:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a505a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.875575:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a505a expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.875585:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a505a expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.875594:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031800, rc 0) 00000100:00100000:0.0:1786400339.875632:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392912384:12345-0@lo:101: Request processed in 107us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400339.875637:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1786400339.875826:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392912384:0@lo:101: 00010000:00010000:3.0:1786400339.875837:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.875845:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400339.875886:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392912512:0@lo:501: 00000100:00100000:3.0:1786400339.875909:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.875933:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.876784:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392912512 00000100:00100000:1.0:1786400339.876791:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392912512 00000100:00100000:1.0:1786400339.876826:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1786400339.876834:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392912512:12345-0@lo:501: 00000100:00100000:1.0:1786400339.877094:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392912512:12345-0@lo:501: Request processed in 260us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.877101:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1786400339.877141:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392912512:0@lo:501: 00000100:00100000:1.0:1786400339.877184:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392912640:0@lo:503: 00000100:00100000:1.0:1786400339.877221:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.877244:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871180 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.877262:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392912640 00000100:00100000:1.0:1786400339.877266:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392912640 00000100:00100000:1.0:1786400339.877282:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1786400339.877288:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392912640:12345-0@lo:503: 00000100:00100000:1.0:1786400339.877559:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392912640:12345-0@lo:503: Request processed in 270us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.877566:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1786400339.877603:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392912640:0@lo:503: 00000100:00100000:0.0:1786400339.884149:0:7817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7817:1873176392912768:0@lo:502: 00000100:00100000:0.0:1786400339.884252:0:7817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400339.884296:0:7817:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d86a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.884350:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392912768 00000100:00100000:1.0:1786400339.884358:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392912768 00000100:00100000:1.0:1786400339.884407:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1786400339.884416:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:7817:x1873176392912768:12345-0@lo:502: 00000100:00100000:1.0:1786400339.884717:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:7817:x1873176392912768:12345-0@lo:502: Request processed in 301us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.884725:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786400339.887131:0:7817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7817:1873176392912768:0@lo:502: 00000020:01000000:0.0:1786400339.887191:0:7817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400339.887203:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400339.887205:0:7817:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786400339.887210:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786400339.887212:0:7817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1786400339.887242:0:7817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7817:1873176392912896:0@lo:502: 00000100:00100000:0.0:1786400339.887312:0:7817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400339.887364:0:7817:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d86a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.889087:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392912896 00000100:00100000:1.0:1786400339.889108:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392912896 00000100:00100000:1.0:1786400339.889175:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1786400339.889185:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:7817:x1873176392912896:12345-0@lo:502: 00000100:00100000:1.0:1786400339.889440:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:7817:x1873176392912896:12345-0@lo:502: Request processed in 256us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.889449:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1786400339.889587:0:7817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7817:1873176392912896:0@lo:502: 00000020:01000000:0.0:1786400339.889618:0:7817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400339.889625:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400339.889627:0:7817:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786400339.889631:0:7817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1786400339.889909:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1786400339.889927:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786400339.889937:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.889957:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400339.889967:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786400339.889970:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373910fb800 from 30 10000000:01000000:1.0:1786400339.889972:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786400339.890001:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.890009:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.890018:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400339.890037:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913024:0@lo:101: 00000100:00100000:1.0:1786400339.890086:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.890125:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937382dae600 going to sleep for 11 seconds 00000100:00100000:0.0:1786400339.891819:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392913024 00000100:00100000:0.0:1786400339.891829:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392913024 00000100:00100000:0.0:1786400339.891874:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786400339.891883:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392913024:12345-0@lo:101: 00010000:00010000:0.0:1786400339.891895:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400339.891910:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5068 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.891933:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.891943:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.891952:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030400, rc 0) 00000100:00100000:0.0:1786400339.892006:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392913024:12345-0@lo:101: Request processed in 123us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400339.892013:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1786400339.892116:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913024:0@lo:101: 00010000:00010000:1.0:1786400339.892132:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.892141:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400339.892210:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913152:0@lo:501: 00000100:00100000:1.0:1786400339.892240:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.892290:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937382dae600 going to sleep for 11 seconds 00000100:00100000:0.0:1786400339.892406:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392913152 00000100:00100000:0.0:1786400339.892411:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392913152 00000100:00100000:0.0:1786400339.892439:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1786400339.892446:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392913152:12345-0@lo:501: 00000100:00100000:0.0:1786400339.892712:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392913152:12345-0@lo:501: Request processed in 265us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400339.892726:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1786400339.893019:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913152:0@lo:501: 00000100:00100000:1.0:1786400339.893053:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913280:0@lo:503: 00000100:00100000:1.0:1786400339.893102:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.893132:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937382dae600 going to sleep for 11 seconds 00000100:00100000:0.0:1786400339.893450:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392913280 00000100:00100000:0.0:1786400339.893456:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392913280 00000100:00100000:0.0:1786400339.893498:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786400339.893506:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392913280:12345-0@lo:503: 00000100:00100000:0.0:1786400339.893677:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392913280:12345-0@lo:503: Request processed in 171us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400339.893835:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913280:0@lo:503: 00000100:00100000:0.0:1786400339.894672:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786400339.895853:0:7818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7818:1873176392913408:0@lo:502: 00000100:00100000:0.0:1786400339.895920:0:7818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400339.895952:0:7818:0:(client.c:2702:ptlrpc_set_wait()) set ffff937391b466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.896009:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392913408 00000100:00100000:1.0:1786400339.896016:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392913408 00000100:00100000:1.0:1786400339.896055:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786400339.896062:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+16:7818:x1873176392913408:12345-0@lo:502: 00000100:00100000:1.0:1786400339.896314:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+16:7818:x1873176392913408:12345-0@lo:502: Request processed in 252us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.896321:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1786400339.905771:0:7818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7818:1873176392913408:0@lo:502: 00000100:00100000:2.0:1786400339.905859:0:7818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7818:1873176392913536:0@lo:502: 00000100:00100000:2.0:1786400339.905930:0:7818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400339.905972:0:7818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b07309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.907639:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392913536 00000100:00100000:1.0:1786400339.907652:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392913536 00000100:00100000:1.0:1786400339.907883:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786400339.907895:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:7818:x1873176392913536:12345-0@lo:502: 00000100:00100000:1.0:1786400339.908193:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:7818:x1873176392913536:12345-0@lo:502: Request processed in 300us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.908201:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786400339.908303:0:7818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7818:1873176392913536:0@lo:502: 00000040:00080000:2.0:1786400339.908334:0:7818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1786400339.910704:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1786400339.910752:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786400339.910766:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400339.910778:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400339.910788:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786400339.910791:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9373910fb800 from 5 10000000:01000000:2.0:1786400339.910793:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786400339.910838:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400339.910867:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400339.910878:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400339.910902:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913664:0@lo:101: 00000100:00100000:2.0:1786400339.910966:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.917996:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b07309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400339.918045:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392913664 00000100:00100000:0.0:1786400339.918055:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392913664 00000100:00100000:0.0:1786400339.920321:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1786400339.920335:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392913664:12345-0@lo:101: 00010000:00010000:0.0:1786400339.920356:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400339.920379:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380030000/0x49554f35ff0a507d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5076 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.920411:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380030000/0x49554f35ff0a507d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5076 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.920423:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380030000/0x49554f35ff0a507d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5076 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400339.920431:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030000, rc 0) 00000100:00100000:0.0:1786400339.920515:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392913664:12345-0@lo:101: Request processed in 183us (9548us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400339.920528:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786400339.929657:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913664:0@lo:101: 00010000:00010000:3.0:1786400339.945468:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.945500:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400339.945592:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913792:0@lo:256: 00000100:00100000:3.0:1786400339.945668:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.945729:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400339.945909:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392913792 00000100:00100000:2.0:1786400339.945919:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392913792 00000100:00100000:2.0:1786400339.945977:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786400339.945987:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392913792:12345-0@lo:256: 20000000:01000000:2.0:1786400339.946011:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786400339.946029:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786400339.946032:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1786400339.946120:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392913792:12345-0@lo:256: Request processed in 133us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400339.946128:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786400339.952307:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913792:0@lo:256: 10000000:01000000:3.0:1786400339.952406:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786400339.952418:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.952430:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400339.952440:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1786400339.952444:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1786400339.952446:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1786400339.952482:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.952489:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.952498:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400339.952517:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913920:0@lo:101: 00000100:00100000:3.0:1786400339.952578:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.952616:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400339.952636:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392913920 00000100:00100000:3.0:1786400339.952643:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392913920 00000100:00100000:3.0:1786400339.952695:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786400339.952704:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392913920:12345-0@lo:101: 00010000:00010000:3.0:1786400339.952729:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400339.952758:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5084 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.952783:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.952793:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.952802:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763200, rc 0) 00000100:00100000:3.0:1786400339.952840:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392913920:12345-0@lo:101: Request processed in 136us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400339.952846:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786400339.952884:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392913920:0@lo:101: 00010000:00010000:3.0:1786400339.952895:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.952904:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400339.952949:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392914048:0@lo:501: 00000100:00100000:3.0:1786400339.952971:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.952984:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400339.952997:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392914048 00000100:00100000:3.0:1786400339.953000:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392914048 00000100:00100000:3.0:1786400339.953021:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786400339.953027:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392914048:12345-0@lo:501: 00000100:00100000:3.0:1786400339.953299:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392914048:12345-0@lo:501: Request processed in 270us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400339.953306:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786400339.953337:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392914048:0@lo:501: 00000100:00100000:3.0:1786400339.953361:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392914176:0@lo:503: 00000100:00100000:3.0:1786400339.953399:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.953412:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400339.953423:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392914176 00000100:00100000:3.0:1786400339.953427:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392914176 00000100:00100000:3.0:1786400339.953444:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786400339.953450:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392914176:12345-0@lo:503: 00000100:00100000:3.0:1786400339.953727:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392914176:12345-0@lo:503: Request processed in 276us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400339.953734:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786400339.953794:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392914176:0@lo:503: 00000100:00100000:3.0:1786400339.953976:0:7821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7821:1873176392914304:0@lo:502: 00000100:00100000:3.0:1786400339.954009:0:7821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400339.954026:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392914304 00000100:00100000:3.0:1786400339.954029:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392914304 00000100:00100000:3.0:1786400339.954049:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1786400339.954055:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:7821:x1873176392914304:12345-0@lo:502: 00000100:00100000:3.0:1786400339.954268:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:7821:x1873176392914304:12345-0@lo:502: Request processed in 211us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400339.954274:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1786400339.954302:0:7821:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400339.954319:0:7821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7821:1873176392914304:0@lo:502: 00000020:01000000:3.0:1786400339.954339:0:7821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786400339.954346:0:7821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1786400339.954353:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400339.954355:0:7821:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1786400339.954360:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786400339.954364:0:7821:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.123@tcp to nid 0x20000c0a8c97b (192.168.201.123@tcp) 00000020:01000000:3.0:1786400339.954386:0:7821:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786400339.954389:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786400339.954405:0:7821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9373b7b58000) 00000020:00000080:3.0:1786400339.954425:0:7821:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1786400339.954431:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786400339.954500:0:7821:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1786400339.954506:0:7821:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1786400339.954514:0:7821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a5099 00010000:00080000:3.0:1786400339.954551:0:7821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373b9c2b800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:3.0:1786400339.954786:0:7821:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1786400339.955069:0:7821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1786400339.955079:0:7821:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1786400339.967280:0:7821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400339.967504:0:7821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400339.967554:0:7821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1786400339.967610:0:7821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1786400339.969325:0:7822:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400339.969332:0:7822:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1786400339.969913:0:7821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786400339.969925:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786400339.969955:0:7821:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1786400339.969976:0:7821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a50a0 00000100:00080000:1.0:1786400339.969985:0:7821:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786400339.969990:0:7821:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9373b9c2b800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1786400339.970023:0:7821:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b75aea00 x1873176392914432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786400339.970056:0:7821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1786400339.970103:0:7821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400339.970106:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400339.970108:0:7821:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1786400339.970111:0:7821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400339.970115:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400339.970117:0:7821:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786400339.970120:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786400339.970122:0:7821:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1786400339.970146:0:7821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7821:1873176392914560:0@lo:502: 00000100:00100000:1.0:1786400339.970230:0:7821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.970261:0:7821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.970279:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392914560 00000100:00100000:1.0:1786400339.970284:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392914560 00000100:00100000:1.0:1786400339.970316:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1786400339.970323:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:7821:x1873176392914560:12345-0@lo:502: 00000100:00100000:3.0:1786400339.970731:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392914432:0@lo:8: 00000100:00100000:3.0:1786400339.970789:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.970956:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:7821:x1873176392914560:12345-0@lo:502: Request processed in 632us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.970965:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1786400339.971042:0:7821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:7821:1873176392914560:0@lo:502: 00000020:01000000:3.0:1786400339.971066:0:7821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400339.971074:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400339.971076:0:7821:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1786400339.971080:0:7821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1786400339.971206:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1786400339.971224:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786400339.971233:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.971244:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400339.971254:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1786400339.971261:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9373a0c50000 from 1 10000000:01000000:1.0:1786400339.971264:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786400339.971287:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.971295:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400339.971304:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400339.971315:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392914688:0@lo:101: 00000100:00100000:1.0:1786400339.971339:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.971390:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372780 going to sleep for 11 seconds 00000100:00100000:1.0:1786400339.974672:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392914816:0@lo:400: 00000100:00100000:1.0:1786400339.974777:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.974820:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400339.974826:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392915200:0@lo:400: 00000100:00100000:1.0:1786400339.974848:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.974875:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392914944:0@lo:400: 00000100:00100000:1.0:1786400339.974901:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.974919:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400339.974925:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392915072:0@lo:400: 00000100:00100000:1.0:1786400339.974974:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400339.975013:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392914816 00000100:00100000:1.0:1786400339.975021:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392914816 00000100:00100000:1.0:1786400339.975066:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392915200 00000100:00100000:1.0:1786400339.975070:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392915200 00000100:00100000:1.0:1786400339.975084:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392914944 00000100:00100000:1.0:1786400339.975094:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392914944 00000100:00100000:1.0:1786400339.975114:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786400339.975122:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392914816:12345-0@lo:400: 00000100:00100000:1.0:1786400339.975183:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392914816:12345-0@lo:400: Request processed in 61us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.975190:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786400339.975206:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786400339.975211:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392915200:12345-0@lo:400: 00000100:00100000:1.0:1786400339.975234:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392915200:12345-0@lo:400: Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.975240:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786400339.975249:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786400339.975255:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392914944:12345-0@lo:400: 00000100:00100000:1.0:1786400339.975282:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392914944:12345-0@lo:400: Request processed in 27us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.975287:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786400339.975310:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392914432 00000100:00100000:1.0:1786400339.975314:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392914432 00000100:00100000:1.0:1786400339.975329:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392915072 00000100:00100000:1.0:1786400339.975332:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392915072 00000100:00100000:1.0:1786400339.975346:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400339.975351:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392915072:12345-0@lo:400: 00000100:00100000:1.0:1786400339.975377:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392915072:12345-0@lo:400: Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.975382:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400339.975393:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400339.975397:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1873176392914432:12345-0@lo:8: 00010000:00080000:1.0:1786400339.975431:0:6623:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:1.0:1786400339.975459:0:6623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a50ae 00002000:00100000:1.0:1786400339.975475:0:6623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9373b04b3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1786400339.975480:0:6623:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1786400339.975485:0:6623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1786400339.975617:0:6623:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1786400339.975797:0:6623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786400339.975823:0:6623:0:(import.c:65:import_set_state_nolock()) ffff9373b04b5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400339.975866:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1873176392914432:12345-0@lo:8: Request processed in 466us (5075us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400339.975874:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1786400339.975911:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75adc00 x1873176392915200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400339.975926:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392915200:0@lo:400: 00010000:00080000:1.0:1786400339.975938:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75adf80 x1873176392914816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400339.975946:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392914816:0@lo:400: 00010000:00080000:1.0:1786400339.975975:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75ad500 x1873176392915072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400339.975983:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392915072:0@lo:400: 00010000:00080000:1.0:1786400339.975991:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75ad880 x1873176392914944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400339.975999:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392914944:0@lo:400: 00010000:00080000:1.0:1786400339.976028:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75aea00 x1873176392914432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786400349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400339.976042:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786400339.976048:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1786400339.976056:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1786400339.976061:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1786400339.976064:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b9c2b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1786400339.976079:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1786400339.976084:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392914432:0@lo:8: 00000100:00100000:3.0:1786400339.984354:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392914688 00000100:00100000:3.0:1786400339.984372:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392914688 00000100:00100000:3.0:1786400339.984447:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786400339.984458:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392914688:12345-0@lo:101: 00010000:00010000:3.0:1786400339.984476:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400339.984514:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a50a7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.984544:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.984555:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400339.984564:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763e00, rc 0) 00000100:00100000:3.0:1786400339.984652:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392914688:12345-0@lo:101: Request processed in 197us (13312us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400339.984659:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:3.0:1786400339.987444:0:7822:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786400339.987931:0:7822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 261729190493ns, next at 0ns, rc = 0 00000100:00100000:1.0:1786400340.001897:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392914688:0@lo:101: 00010000:00010000:1.0:1786400340.001926:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400340.001938:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400340.002022:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392915328:0@lo:501: 00000100:00100000:1.0:1786400340.002089:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400340.002133:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400340.003035:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392915328 00000100:00100000:0.0:1786400340.003045:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392915328 00000100:00100000:0.0:1786400340.003096:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786400340.003106:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392915328:12345-0@lo:501: 00000100:00100000:0.0:1786400340.003411:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392915328:12345-0@lo:501: Request processed in 305us (1319us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400340.003419:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786400340.003473:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392915328:0@lo:501: 10000000:01000000:0.0:1786400340.003526:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786400340.003535:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400340.003545:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400340.057833:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392915456:0@lo:13: 00000100:00100000:3.0:1786400340.057903:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400340.057937:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392915456 00000100:00100000:2.0:1786400340.057945:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392915456 00000004:00080000:3.0:1786400340.057960:0:7823:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1786400340.057980:0:7823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7823:1873176392915584:0@lo:7: 00000100:00100000:2.0:1786400340.057994:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400340.058003:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392915456:12345-0@lo:13: 00000100:00100000:3.0:1786400340.058004:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400340.058024:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392915584 00002000:00000024:2.0:1786400340.058033:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1786400340.058034:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392915584 00000100:00100000:3.0:1786400340.058058:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400340.058064:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7823:x1873176392915584:12345-0@lo:7: 00000100:00100000:2.0:1786400340.058075:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1873176392915456:12345-0@lo:13: Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400340.058082:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1786400340.059613:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400340.069479:0:7823:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738407e240 going to sleep for 11 seconds 00010000:00080000:0.0:1786400340.080851:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373a0c71500 x1873176392915456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400340.080879:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392915456:0@lo:13: 00002000:00080000:3.0:1786400340.084404:0:6623:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1786400340.084413:0:6623:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1786400340.084521:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7823:x1873176392915584:12345-0@lo:7: Request processed in 26452us (26511us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400340.084533:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1786400340.084605:0:7823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373a0c73100 x1873176392915584/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786400356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400340.084622:0:7823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7823:1873176392915584:0@lo:7: 00000004:00080000:3.0:1786400340.084638:0:7823:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1786400340.086634:0:7823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7823:1873176392915712:0@lo:5: 00000100:00100000:3.0:1786400340.086830:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400340.086881:0:7823:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400340.087595:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392915712 00000100:00100000:1.0:1786400340.087606:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392915712 00000100:00100000:1.0:1786400340.087690:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400340.087699:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1873176392915712:12345-0@lo:5: 00002000:00080000:1.0:1786400340.087729:0:6622:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1786400340.087733:0:6622:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1786400340.088147:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7823:x1873176392915712:12345-0@lo:5: Request processed in 448us (1315us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1786400340.088155:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1786400340.088716:0:7823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373a0c73100 x1873176392915712/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400340.088731:0:7823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7823:1873176392915712:0@lo:5: 00000004:00080000:3.0:1786400340.088768:0:7823:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1786400340.088804:0:7823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7823:1873176392915840:0@lo:700: 00000100:00100000:3.0:1786400340.088836:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400340.088854:0:7823:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400340.088977:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392915840 00000100:00100000:1.0:1786400340.088982:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392915840 00000100:00100000:1.0:1786400340.089024:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400340.089031:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7823:x1873176392915840:12345-0@lo:700: 00000100:00100000:1.0:1786400340.089064:0:6631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6631:1873176392915968:0@lo:700: 00000100:00100000:1.0:1786400340.089091:0:6631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400340.089109:0:6631:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400340.089126:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392915968 00000100:00100000:1.0:1786400340.089129:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392915968 00000100:00100000:1.0:1786400340.089174:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400340.089181:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6631:x1873176392915968:12345-0@lo:700: 00000100:00080000:0.0:1786400340.091616:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786400340.117816:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786400340.161691:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1786400340.222461:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1786400340.227999:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6631:x1873176392915968:12345-0@lo:700: Request processed in 138810us (138898us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400340.228014:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786400340.229083:0:6631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b79c9880 x1873176392915968/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786400356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400340.229100:0:6631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6631:1873176392915968:0@lo:700: 40000000:02000000:3.0:1786400340.229134:0:6631:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1786400340.375316:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7823:x1873176392915840:12345-0@lo:700: Request processed in 286273us (286466us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400340.375339:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786400340.375403:0:7823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373a0c70700 x1873176392915840/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786400356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400340.375420:0:7823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7823:1873176392915840:0@lo:700: 00000001:00080000:1.0:1786400340.378530:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1786400340.378561:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1786400340.461540:0:7823:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1786400340.467640:0:7823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7823:1873176392916096:0@lo:5: 00000100:00100000:0.0:1786400340.467714:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400340.467793:0:7823:0:(client.c:2702:ptlrpc_set_wait()) set ffff937391b466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400340.471441:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392916096 00000100:00100000:3.0:1786400340.471458:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392916096 00000100:00100000:3.0:1786400340.471531:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400340.471543:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7823:x1873176392916096:12345-0@lo:5: 00002000:00080000:3.0:1786400340.491590:0:6623:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1786400340.491627:0:6623:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1786400340.496140:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7823:x1873176392916096:12345-0@lo:5: Request processed in 24590us (28415us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1786400340.496153:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1786400340.496214:0:7823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c65880 x1873176392916096/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400340.496237:0:7823:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1786400340.496255:0:7823:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff937388c65880 x1873176392916096/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400356 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400340.496268:0:7823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7823:1873176392916096:0@lo:5: 00000004:00080000:2.0:1786400340.496283:0:7823:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1786400341.139337:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400341.172729:0:7882:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1786400341.404439:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392916224:0@lo:13: 00000100:00100000:0.0:1786400341.404528:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400341.404623:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392916224 00000100:00100000:0.0:1786400341.404634:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392916224 00000100:00100000:0.0:1786400341.404711:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786400341.404722:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392916224:12345-0@lo:13: 00002000:00000024:0.0:1786400341.404806:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400341.404867:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392916224:12345-0@lo:13: Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400341.404878:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1786400341.404902:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786400341.404936:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c67100 x1873176392916224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400341.404956:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392916224:0@lo:13: 00010000:00010000:3.0:1786400342.172699:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400343.189321:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400344.210948:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400344.979946:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392916608:0@lo:400: 00000100:00100000:0.0:1786400344.980020:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400344.980097:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786400344.980104:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392916480:0@lo:400: 00000100:00100000:0.0:1786400344.980130:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400344.980146:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392916992:0@lo:400: 00000100:00100000:0.0:1786400344.980168:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400344.980206:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392916992 00000100:00100000:0.0:1786400344.980219:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392916992 00000100:00100000:0.0:1786400344.980270:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786400344.980278:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392916992:12345-0@lo:400: 00000100:00100000:0.0:1786400344.980330:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392916992:12345-0@lo:400: Request processed in 52us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400344.980338:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1786400344.980357:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1786400344.980384:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3aa00 x1873176392916992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400344.980399:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392916992:0@lo:400: 00000100:00100000:2.0:1786400344.980537:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392916736:0@lo:400: 00000100:00100000:2.0:1786400344.980576:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400344.980602:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786400344.980608:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392916352:0@lo:400: 00000100:00100000:2.0:1786400344.980633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400344.980653:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392916864:0@lo:400: 00000100:00100000:2.0:1786400344.980671:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400344.980831:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392916608 00000100:00100000:1.0:1786400344.980837:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392916608 00000100:00100000:1.0:1786400344.980877:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392916480 00000100:00100000:1.0:1786400344.980881:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392916480 00000100:00100000:1.0:1786400344.980893:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392916864 00000100:00100000:1.0:1786400344.980895:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392916864 00000100:00100000:1.0:1786400344.980908:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786400344.980914:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392916608:12345-0@lo:400: 00000100:00100000:1.0:1786400344.980966:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392916608:12345-0@lo:400: Request processed in 52us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400344.980973:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786400344.980985:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786400344.980991:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392916480:12345-0@lo:400: 00000100:00100000:1.0:1786400344.981025:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392916480:12345-0@lo:400: Request processed in 35us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400344.981032:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786400344.981042:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786400344.981048:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392916864:12345-0@lo:400: 00000100:00100000:1.0:1786400344.981076:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392916864:12345-0@lo:400: Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400344.981095:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786400344.981116:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392916736 00000100:00100000:1.0:1786400344.981120:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392916736 00000100:00100000:1.0:1786400344.981144:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400344.981150:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392916736:12345-0@lo:400: 00000100:00100000:1.0:1786400344.981178:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392916736:12345-0@lo:400: Request processed in 28us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400344.981184:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1786400344.981214:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e38700 x1873176392916864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400344.981224:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392916864:0@lo:400: 00010000:00080000:1.0:1786400344.981234:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3b100 x1873176392916736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400344.981242:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392916736:0@lo:400: 00010000:00080000:1.0:1786400344.981271:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e38a80 x1873176392916480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400344.981280:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392916480:0@lo:400: 00010000:00080000:1.0:1786400344.981289:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e39880 x1873176392916608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400344.981304:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392916608:0@lo:400: 00000100:00100000:3.0:1786400344.981687:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392916352 00000100:00100000:3.0:1786400344.981692:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392916352 00000100:00100000:3.0:1786400344.981726:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1786400344.981733:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392916352:12345-0@lo:400: 00000100:00100000:3.0:1786400344.981804:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392916352:12345-0@lo:400: Request processed in 72us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400344.981811:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1786400344.982701:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786400344.982708:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400344.982802:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392916352:0@lo:400: 00010000:00010000:3.0:1786400345.240565:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400345.491956:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400345.491979:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392917120:0@lo:13: 00000100:00100000:0.0:1786400345.492039:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400345.492109:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392917120 00000100:00100000:0.0:1786400345.492115:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392917120 00000100:00100000:0.0:1786400345.492155:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786400345.492164:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1873176392917120:12345-0@lo:13: 00002000:00000024:0.0:1786400345.492192:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400345.492231:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1873176392917120:12345-0@lo:13: Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400345.492237:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1786400345.492272:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3aa00 x1873176392917120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400345.492288:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392917120:0@lo:13: 00000001:00080000:0.0:1786400345.705878:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1786400346.258898:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400346.514938:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392917248:0@lo:13: 00000100:00100000:2.0:1786400346.515022:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400346.515264:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392917248 00000100:00100000:0.0:1786400346.515272:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392917248 00000100:00100000:0.0:1786400346.515342:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786400346.515352:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392917248:12345-0@lo:13: 00002000:00000024:0.0:1786400346.515385:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400346.515446:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392917248:12345-0@lo:13: Request processed in 95us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400346.515454:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1786400346.515523:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400346.515550:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3aa00 x1873176392917248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400346.515575:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392917248:0@lo:13: 00010000:00010000:3.0:1786400347.283551:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400347.947040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400347.947772:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368775296 00000100:00100000:1.0:1786400347.947782:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368775296 00000100:00100000:1.0:1786400347.947828:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:1.0:1786400347.947836:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2358:x1873176368775296:12345-192.168.201.23@tcp:250: 00010000:00080000:1.0:1786400347.947862:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6e6bd34d-d4c5-467c-8069-f8c8a16a72d9@192.168.201.23@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:1.0:1786400347.948006:0:5809:0:(genops.c:1406:class_connect()) connect: client 6e6bd34d-d4c5-467c-8069-f8c8a16a72d9, cookie 0x49554f35ff0a50bc 00000100:00080000:1.0:1786400347.948278:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9373b04b1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400347.948346:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+5:2358:x1873176368775296:12345-192.168.201.23@tcp:250: Request processed in 508us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400347.948354:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:3.0:1786400347.954382:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400347.954588:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368775424 00000100:00100000:0.0:1786400347.954599:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368775424 00000100:00100000:0.0:1786400347.954655:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:0.0:1786400347.954666:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+5:5565:x1873176368775424:12345-192.168.201.23@tcp:101: 00010000:00010000:0.0:1786400347.954684:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400347.954702:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4f76 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400347.954729:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400347.954758:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400347.954767:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031000, rc 0) 00000100:00100000:0.0:1786400347.954822:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+6:5565:x1873176368775424:12345-192.168.201.23@tcp:101: Request processed in 158us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400347.954829:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:0.0:1786400347.957786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400347.958283:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368775552 00000100:00100000:2.0:1786400347.958293:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368775552 00000100:00100000:2.0:1786400347.958355:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:2.0:1786400347.958365:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+6:5565:x1873176368775552:12345-192.168.201.23@tcp:501: 00000100:00100000:2.0:1786400347.958923:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+6:5565:x1873176368775552:12345-192.168.201.23@tcp:501: Request processed in 557us (1144us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400347.958932:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:3.0:1786400347.982080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400347.982572:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368775680 00000100:00100000:0.0:1786400347.982644:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368775680 00000100:00100000:0.0:1786400347.982711:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:0.0:1786400347.982720:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+6:5565:x1873176368775680:12345-192.168.201.23@tcp:101: 00010000:00010000:0.0:1786400347.982736:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400347.982769:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4f7d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400347.982798:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400347.982808:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400347.982817:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031a00, rc 0) 00000100:00100000:0.0:1786400347.982867:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+7:5565:x1873176368775680:12345-192.168.201.23@tcp:101: Request processed in 149us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400347.982873:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:1.0:1786400347.990657:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400347.990770:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368775808 00000100:00100000:3.0:1786400347.990781:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368775808 00000100:00100000:3.0:1786400347.990828:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:3.0:1786400347.990837:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+7:5565:x1873176368775808:12345-192.168.201.23@tcp:501: 00000100:00100000:3.0:1786400347.991520:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5565:x1873176368775808:12345-192.168.201.23@tcp:501: Request processed in 679us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400347.991529:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:0.0:1786400347.997250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400347.997929:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368775936 00000100:00100000:1.0:1786400347.997943:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368775936 00000100:00100000:1.0:1786400347.998002:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:1.0:1786400347.998144:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5565:x1873176368775936:12345-192.168.201.23@tcp:503: 00000100:00100000:1.0:1786400347.999865:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5565:x1873176368775936:12345-192.168.201.23@tcp:503: Request processed in 1715us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400347.999878:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:1.0:1786400348.008181:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400348.009402:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368776064 00000100:00100000:0.0:1786400348.009416:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368776064 00000100:00100000:0.0:1786400348.009469:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:0.0:1786400348.009478:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5584:x1873176368776064:12345-192.168.201.23@tcp:502: 00000100:00100000:0.0:1786400348.010432:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5584:x1873176368776064:12345-192.168.201.23@tcp:502: Request processed in 948us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400348.010443:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:0.0:1786400348.049107:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400348.049240:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368776192 00000100:00100000:3.0:1786400348.049253:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368776192 00000100:00100000:3.0:1786400348.049322:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:3.0:1786400348.049333:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5584:x1873176368776192:12345-192.168.201.23@tcp:502: 00000100:00100000:3.0:1786400348.049884:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5584:x1873176368776192:12345-192.168.201.23@tcp:502: Request processed in 551us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400348.049893:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:0.0:1786400348.064192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400348.064347:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368776320 00000100:00100000:1.0:1786400348.064359:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368776320 00000100:00100000:1.0:1786400348.064501:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:1.0:1786400348.064512:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5565:x1873176368776320:12345-192.168.201.23@tcp:101: 00010000:00010000:1.0:1786400348.064545:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400348.064563:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373994f4400/0x49554f35ff0a50d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4fa7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400348.066009:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f4400/0x49554f35ff0a50d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fa7 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400348.066331:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373994f4400/0x49554f35ff0a50d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fa7 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400348.066343:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373994f4400, rc 0) 00000100:00100000:1.0:1786400348.066489:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5565:x1873176368776320:12345-192.168.201.23@tcp:101: Request processed in 1972us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400348.066499:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:1.0:1786400348.074651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400348.074806:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368776448 00000100:00100000:3.0:1786400348.074819:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368776448 00000100:00100000:3.0:1786400348.074876:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:3.0:1786400348.074885:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5565:x1873176368776448:12345-192.168.201.23@tcp:256: 20000000:01000000:3.0:1786400348.074912:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1786400348.074938:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1786400348.074942:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1786400348.074945:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1786400348.074947:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1786400348.079124:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5565:x1873176368776448:12345-192.168.201.23@tcp:256: Request processed in 4225us (4470us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400348.079156:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:1.0:1786400348.086896:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400348.087170:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368776576 00000100:00100000:2.0:1786400348.087182:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368776576 00000100:00100000:2.0:1786400348.087237:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:2.0:1786400348.087248:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5565:x1873176368776576:12345-192.168.201.23@tcp:101: 00010000:00010000:2.0:1786400348.087267:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400348.087289:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4fae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400348.087319:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400348.087330:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400348.087339:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fda00, rc 0) 00000100:00100000:2.0:1786400348.087819:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5565:x1873176368776576:12345-192.168.201.23@tcp:101: Request processed in 571us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400348.087827:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:0.0:1786400348.093809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400348.093878:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368776704 00000100:00100000:3.0:1786400348.093887:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368776704 00000100:00100000:3.0:1786400348.093934:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:3.0:1786400348.093944:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5565:x1873176368776704:12345-192.168.201.23@tcp:501: 00000100:00100000:3.0:1786400348.094513:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5565:x1873176368776704:12345-192.168.201.23@tcp:501: Request processed in 569us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400348.094522:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:0.0:1786400348.100830:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400348.101240:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368776832 00000100:00100000:1.0:1786400348.101254:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368776832 00000100:00100000:1.0:1786400348.101326:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00100000:1.0:1786400348.101336:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5565:x1873176368776832:12345-192.168.201.23@tcp:503: 00000100:00100000:1.0:1786400348.102162:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5565:x1873176368776832:12345-192.168.201.23@tcp:503: Request processed in 824us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400348.102172:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00100000:1.0:1786400348.107510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400348.112859:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368776960 00000100:00100000:2.0:1786400348.112874:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368776960 00000100:00100000:2.0:1786400348.112979:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 126 00000100:00100000:2.0:1786400348.112990:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5589:x1873176368776960:12345-192.168.201.23@tcp:502: 00000100:00100000:2.0:1786400348.113261:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5589:x1873176368776960:12345-192.168.201.23@tcp:502: Request processed in 272us (5760us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400348.113287:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 126 00000100:00100000:3.0:1786400348.124001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400348.127991:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368777088 00000100:00100000:1.0:1786400348.128008:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368777088 00000100:00100000:1.0:1786400348.128672:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 127 00000100:00100000:1.0:1786400348.128687:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5589:x1873176368777088:12345-192.168.201.23@tcp:502: 00000100:00100000:1.0:1786400348.128947:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5589:x1873176368777088:12345-192.168.201.23@tcp:502: Request processed in 264us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400348.128955:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 127 00000100:00100000:3.0:1786400348.134979:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400348.136276:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368777216 00000100:00100000:3.0:1786400348.136287:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368777216 00000100:00100000:3.0:1786400348.136344:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:3.0:1786400348.136352:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1873176368777216:12345-192.168.201.23@tcp:38: 00010000:00080000:3.0:1786400348.136381:0:5818:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:3.0:1786400348.136999:0:5818:0:(genops.c:1406:class_connect()) connect: client 2e546c9b-fa03-4565-a5c8-6992a70a28db, cookie 0x49554f35ff0a50df 00000004:00100000:3.0:1786400348.137166:0:5818:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1786400348.137175:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1786400348.178836:0:5818:0:(import.c:65:import_set_state_nolock()) ffff9373bf3f3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400348.178919:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2358:x1873176368777216:12345-192.168.201.23@tcp:38: Request processed in 42565us (43949us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400348.178930:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00010000:00010000:3.0:1786400348.306887:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400349.194004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400349.194150:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368777344 00000100:00100000:0.0:1786400349.194162:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368777344 00000100:00100000:0.0:1786400349.194243:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00080000:2.0:1786400349.194385:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400349.194395:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:0:x1873176368777344:12345-192.168.201.23@tcp:41: 00000004:00000024:0.0:1786400349.194440:0:5817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786400349.194529:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:0:x1873176368777344:12345-192.168.201.23@tcp:41: Request processed in 138us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400349.202632:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400349.203213:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786400349.203225:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1786400349.204016:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368777472 00000100:00100000:3.0:1786400349.204027:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368777472 00000100:00100000:1.0:1786400349.204678:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:1.0:1786400349.204692:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:5565:x1873176368777472:12345-192.168.201.23@tcp:41: 00000004:00000024:1.0:1786400349.204723:0:8098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1786400349.205181:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:5565:x1873176368777472:12345-192.168.201.23@tcp:41: Request processed in 491us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400349.205190:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1786400349.207483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400349.207835:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368777600 00000100:00100000:2.0:1786400349.207861:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368777600 00000100:00100000:2.0:1786400349.207926:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:2.0:1786400349.207938:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:5565:x1873176368777600:12345-192.168.201.23@tcp:40: 00000100:00100000:2.0:1786400349.208311:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:5565:x1873176368777600:12345-192.168.201.23@tcp:40: Request processed in 374us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400349.208319:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1786400349.214157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400349.214243:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400349.214294:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368777856 00000100:00100000:3.0:1786400349.214302:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368777856 00000100:00100000:3.0:1786400349.214351:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 128 00000100:00100000:3.0:1786400349.214360:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2359:x1873176368777856:12345-192.168.201.23@tcp:400: 00000100:00100000:3.0:1786400349.214428:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2359:x1873176368777856:12345-192.168.201.23@tcp:400: Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400349.214436:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 128 00000100:00100000:1.0:1786400349.215714:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368777728 00000100:00100000:1.0:1786400349.215722:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368777728 00000100:00100000:1.0:1786400349.215770:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:1.0:1786400349.215777:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873176368777728:12345-192.168.201.23@tcp:8: 00010000:00080000:1.0:1786400349.215802:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1786400349.215831:0:6622:0:(genops.c:1406:class_connect()) connect: client 2e546c9b-fa03-4565-a5c8-6992a70a28db, cookie 0x49554f35ff0a50e6 00002000:00100000:1.0:1786400349.215853:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e546c9b-fa03-4565-a5c8-6992a70a28db/ffff9373b9c59000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786400349.215877:0:6622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786400349.216207:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786400349.216237:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400349.216288:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2358:x1873176368777728:12345-192.168.201.23@tcp:8: Request processed in 511us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400349.216295:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:0.0:1786400349.216707:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:1.0:1786400349.254261:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400349.254320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400349.254447:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368777984 00000100:00100000:0.0:1786400349.254458:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368777984 00000100:00100000:0.0:1786400349.254524:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1786400349.254533:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873176368777984:12345-192.168.201.23@tcp:8: 00000100:00100000:2.0:1786400349.254728:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368778112 00000100:00100000:2.0:1786400349.254733:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368778112 00000100:00100000:2.0:1786400349.254805:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:2.0:1786400349.254813:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:5565:x1873176368778112:12345-192.168.201.23@tcp:33: 00010000:00080000:1.0:1786400349.254933:0:6623:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1786400349.254979:0:6623:0:(genops.c:1406:class_connect()) connect: client 2e546c9b-fa03-4565-a5c8-6992a70a28db, cookie 0x49554f35ff0a50ed 00002000:00100000:1.0:1786400349.254990:0:6623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e546c9b-fa03-4565-a5c8-6992a70a28db/ffff9373bf7d6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786400349.255023:0:6623:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786400349.257971:0:6623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786400349.258025:0:6623:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400349.260347:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2358:x1873176368777984:12345-192.168.201.23@tcp:8: Request processed in 5804us (6086us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400349.260360:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000004:00080000:3.0:1786400349.315501:0:5819:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 60367us 00000004:00200000:1.0:1786400349.332994:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1786400349.333815:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:5565:x1873176368778112:12345-192.168.201.23@tcp:33: Request processed in 78996us (79488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400349.333831:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00010000:00010000:1.0:1786400349.341168:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400349.567166:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400349.567323:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368778240 00000100:00100000:2.0:1786400349.567333:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368778240 00000100:00100000:2.0:1786400349.567402:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:2.0:1786400349.567412:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:5607:x1873176368778240:12345-192.168.201.23@tcp:101: 00010000:00010000:2.0:1786400349.567432:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400349.567512:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c21fd200/0x49554f35ff0a50f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4fd8 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400349.567577:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c21fc200/0x49554f35ff0a50fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400349.567589:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c21fc200/0x49554f35ff0a50fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400349.567616:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c21fc200/0x49554f35ff0a50fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400349.567856:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1786400349.567860:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400349.567938:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373c21fc200/0x49554f35ff0a50fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400349.567967:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c21fd200/0x49554f35ff0a50f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fd8 expref: 8 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400349.567983:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c21fc200/0x49554f35ff0a50fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fd8 expref: 7 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400349.567992:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400349.567995:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786400349.568008:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fc200, rc 0) 00000100:00100000:2.0:1786400349.568080:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:5607:x1873176368778240:12345-192.168.201.23@tcp:101: Request processed in 669us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400349.568087:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1786400350.099083:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392917632:0@lo:400: 00000100:00100000:3.0:1786400350.099158:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400350.099225:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786400350.099232:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392917504:0@lo:400: 00000100:00100000:3.0:1786400350.099255:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400350.099271:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392918016:0@lo:400: 00000100:00100000:3.0:1786400350.099294:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400350.099330:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392918016 00000100:00100000:3.0:1786400350.099337:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392918016 00000100:00100000:3.0:1786400350.099387:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400350.099396:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392918016:12345-0@lo:400: 00000100:00100000:3.0:1786400350.099447:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392918016:12345-0@lo:400: Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400350.099455:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786400350.099487:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392917760:0@lo:400: 00010000:00080000:3.0:1786400350.099499:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937385d7c700 x1873176392918016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400350.099510:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1786400350.099527:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400350.099528:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392918016:0@lo:400: 00000100:00100000:2.0:1786400350.099551:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786400350.099560:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392917376:0@lo:400: 00000100:00100000:3.0:1786400350.099582:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392917632 00000100:00100000:3.0:1786400350.099587:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392917632 00000100:00100000:2.0:1786400350.099593:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400350.099620:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392917888:0@lo:400: 00000100:00100000:3.0:1786400350.099623:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392917504 00000100:00100000:3.0:1786400350.099627:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392917504 00000100:00100000:2.0:1786400350.099648:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400350.099653:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786400350.099662:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392917632:12345-0@lo:400: 00000100:00080000:2.0:1786400350.099683:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786400350.099689:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400350.099702:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392917888 00000100:00100000:3.0:1786400350.099706:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392917632:12345-0@lo:400: Request processed in 45us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400350.099708:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392917888 00000100:00100000:3.0:1786400350.099716:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1786400350.099730:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400350.099734:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786400350.099773:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392917504:12345-0@lo:400: 00000100:00100000:2.0:1786400350.099780:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786400350.099789:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392917888:12345-0@lo:400: 00000100:00100000:3.0:1786400350.099807:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392917504:12345-0@lo:400: Request processed in 36us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400350.099814:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786400350.099838:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392917888:12345-0@lo:400: Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400350.099846:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400350.099850:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392917504:0@lo:400: 00000100:00100000:3.0:1786400350.099864:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392917632:0@lo:400: 00000100:00100000:2.0:1786400350.099882:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392917888:0@lo:400: 00000100:00100000:1.0:1786400350.099973:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392917760 00000100:00100000:1.0:1786400350.099978:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392917760 00000100:00100000:1.0:1786400350.100053:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786400350.100061:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392917760:12345-0@lo:400: 00000100:00100000:1.0:1786400350.100096:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392917760:12345-0@lo:400: Request processed in 37us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400350.100103:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786400350.100319:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392917376 00000100:00100000:0.0:1786400350.100324:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392917376 00000100:00100000:0.0:1786400350.100364:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1786400350.100373:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392917376:12345-0@lo:400: 00000100:00100000:0.0:1786400350.100418:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392917376:12345-0@lo:400: Request processed in 47us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400350.100424:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1786400350.100612:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400350.100634:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392917376:0@lo:400: 00010000:00080000:2.0:1786400350.100646:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937385d7d880 x1873176392917760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400350.100655:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392917760:0@lo:400: 00010000:00010000:3.0:1786400350.355350:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400350.611041:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392918144:0@lo:13: 00000100:00100000:3.0:1786400350.611140:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400350.611348:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392918144 00000100:00100000:0.0:1786400350.611356:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392918144 00000100:00100000:0.0:1786400350.611425:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786400350.611435:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392918144:12345-0@lo:13: 00002000:00000024:0.0:1786400350.611489:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400350.611542:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392918144:12345-0@lo:13: Request processed in 108us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400350.611549:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1786400350.611685:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3b800 x1873176392918144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400350.611703:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392918144:0@lo:13: 00010000:00010000:1.0:1786400351.379503:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400351.635170:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400351.635195:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392918272:0@lo:13: 00000100:00100000:1.0:1786400351.635266:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400351.635478:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392918272 00000100:00100000:0.0:1786400351.635486:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392918272 00000100:00100000:0.0:1786400351.635541:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786400351.635551:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392918272:12345-0@lo:13: 00002000:00000024:0.0:1786400351.635585:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400351.635636:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392918272:12345-0@lo:13: Request processed in 87us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400351.635642:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1786400351.635720:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3a300 x1873176392918272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400351.635779:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392918272:0@lo:13: 00000100:00100000:3.0:1786400351.884143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400351.884234:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368778368 00000100:00100000:2.0:1786400351.884245:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368778368 00000100:00100000:2.0:1786400351.884328:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:2.0:1786400351.884339:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:5659:x1873176368778368:12345-192.168.201.23@tcp:41: 00000004:00000024:2.0:1786400351.884385:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786400351.884457:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:5659:x1873176368778368:12345-192.168.201.23@tcp:41: Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400351.884464:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00080000:0.0:1786400351.884672:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400351.888133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400351.888204:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368778496 00000100:00100000:0.0:1786400351.888216:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368778496 00000100:00100000:0.0:1786400351.888300:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:0.0:1786400351.888311:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:5659:x1873176368778496:12345-192.168.201.23@tcp:13: 00002000:00000024:0.0:1786400351.888336:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400351.888401:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:5659:x1873176368778496:12345-192.168.201.23@tcp:13: Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400351.888408:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00080000:2.0:1786400351.888478:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400351.894570:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400351.895025:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368778624 00000100:00100000:2.0:1786400351.895039:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368778624 00000100:00100000:2.0:1786400351.895130:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1786400351.895140:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:5659:x1873176368778624:12345-192.168.201.23@tcp:13: 00002000:00000024:2.0:1786400351.895166:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400351.895247:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:5659:x1873176368778624:12345-192.168.201.23@tcp:13: Request processed in 108us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400351.895255:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00080000:0.0:1786400351.896228:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786400352.403211:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786400352.762838:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000001:00100000:1.0:1786400353.227220:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00010000:00010000:1.0:1786400353.427018:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786400353.797204:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00010000:00010000:1.0:1786400354.452392:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400354.604682:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400354.604727:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400354.604779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400354.604810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400354.604848:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368779008 00000100:00100000:0.0:1786400354.604872:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368779008 00000100:00100000:0.0:1786400354.604945:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368779136 00000100:00100000:0.0:1786400354.604948:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368779136 00000100:00100000:0.0:1786400354.604973:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1786400354.604984:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368779008:12345-192.168.201.23@tcp:400: 00000100:00100000:0.0:1786400354.605079:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368779008:12345-192.168.201.23@tcp:400: Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400354.605087:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1786400354.605104:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:0.0:1786400354.605111:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368779136:12345-192.168.201.23@tcp:400: 00000100:00100000:0.0:1786400354.605136:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368779136:12345-192.168.201.23@tcp:400: Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400354.605143:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00080000:0.0:1786400354.605161:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400354.605165:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400354.606449:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368778752 00000100:00100000:2.0:1786400354.606458:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368778752 00000100:00100000:2.0:1786400354.606496:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00100000:2.0:1786400354.606504:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2361:x1873176368778752:12345-192.168.201.23@tcp:400: 00000100:00100000:2.0:1786400354.606554:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2361:x1873176368778752:12345-192.168.201.23@tcp:400: Request processed in 51us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400354.606562:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00100000:2.0:1786400354.606885:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368778880 00000100:00100000:2.0:1786400354.606890:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368778880 00000100:00100000:2.0:1786400354.606936:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:2.0:1786400354.606944:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368778880:12345-192.168.201.23@tcp:400: 00000100:00100000:2.0:1786400354.606975:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368778880:12345-192.168.201.23@tcp:400: Request processed in 33us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400354.606982:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00080000:0.0:1786400354.607657:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1786400354.687420:0:8188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1786400355.219037:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392918656:0@lo:400: 00000100:00100000:3.0:1786400355.219126:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400355.219198:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786400355.219205:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392918528:0@lo:400: 00000100:00100000:3.0:1786400355.219226:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400355.219242:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392919040:0@lo:400: 00000100:00100000:3.0:1786400355.219263:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400355.219320:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392918656 00000100:00100000:3.0:1786400355.219328:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392918656 00000100:00100000:3.0:1786400355.219381:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392918528 00000100:00100000:3.0:1786400355.219384:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392918528 00000100:00100000:3.0:1786400355.219405:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786400355.219413:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392918656:12345-0@lo:400: 00000100:00100000:3.0:1786400355.219462:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392918656:12345-0@lo:400: Request processed in 49us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400355.219470:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786400355.219486:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400355.219492:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392918528:12345-0@lo:400: 00000100:00100000:3.0:1786400355.219518:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392918528:12345-0@lo:400: Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400355.219524:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400355.219565:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392918528:0@lo:400: 00000100:00100000:3.0:1786400355.219574:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392918656:0@lo:400: 00000100:00100000:2.0:1786400355.220156:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392918784:0@lo:400: 00000100:00100000:2.0:1786400355.220191:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400355.220226:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786400355.220232:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392918400:0@lo:400: 00000100:00100000:2.0:1786400355.220258:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400355.220316:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392918912:0@lo:400: 00000100:00100000:2.0:1786400355.220342:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400355.220369:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392918400 00000100:00100000:2.0:1786400355.220374:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392918400 00000100:00100000:2.0:1786400355.220403:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1786400355.220410:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392918400:12345-0@lo:400: 00000100:00100000:2.0:1786400355.220447:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392918400:12345-0@lo:400: Request processed in 38us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400355.220454:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1786400355.220504:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392918400:0@lo:400: 00000100:00100000:2.0:1786400355.220522:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392918912 00000100:00100000:2.0:1786400355.220525:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392918912 00000100:00100000:2.0:1786400355.220553:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786400355.220559:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392918912:12345-0@lo:400: 00000100:00100000:2.0:1786400355.220591:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392918912:12345-0@lo:400: Request processed in 32us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400355.220596:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786400355.220636:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392918912:0@lo:400: 00000100:00100000:0.0:1786400355.220878:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392919040 00000100:00100000:0.0:1786400355.220883:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392919040 00000100:00100000:0.0:1786400355.220930:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392918784 00000100:00100000:0.0:1786400355.220934:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392918784 00000100:00100000:0.0:1786400355.220952:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400355.220959:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392919040:12345-0@lo:400: 00000100:00100000:0.0:1786400355.221004:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392919040:12345-0@lo:400: Request processed in 45us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400355.221010:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400355.221023:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786400355.221029:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392918784:12345-0@lo:400: 00000100:00100000:0.0:1786400355.221073:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392918784:12345-0@lo:400: Request processed in 44us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400355.221079:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1786400355.221095:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786400355.221099:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400355.221102:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786400355.221136:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937385d7f800 x1873176392918784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400355.221148:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392918784:0@lo:400: 00010000:00080000:0.0:1786400355.221174:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937385d7e680 x1873176392919040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400355.221184:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392919040:0@lo:400: 00010000:00010000:1.0:1786400355.479334:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400355.732552:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392919168:0@lo:13: 00000100:00100000:3.0:1786400355.732684:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400355.733407:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392919168 00000100:00100000:2.0:1786400355.733417:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392919168 00000100:00100000:2.0:1786400355.733562:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400355.733574:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392919168:12345-0@lo:13: 00002000:00000024:2.0:1786400355.733655:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400355.733775:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392919168:12345-0@lo:13: Request processed in 190us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400355.733784:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1786400355.734544:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b6ec7480 x1873176392919168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400355.734568:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392919168:0@lo:13: 00010000:00010000:3.0:1786400356.515843:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400356.755054:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392919296:0@lo:13: 00000100:00100000:1.0:1786400356.755148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400356.757095:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392919296 00000100:00100000:3.0:1786400356.757110:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392919296 00000100:00100000:3.0:1786400356.757396:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786400356.757407:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392919296:12345-0@lo:13: 00002000:00000024:3.0:1786400356.757446:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400356.757526:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392919296:12345-0@lo:13: Request processed in 121us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400356.757575:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1786400356.757611:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3ad80 x1873176392919296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400356.757641:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392919296:0@lo:13: 00010000:00010000:1.0:1786400357.523401:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786400358.368120:0:8336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff76a63600 00000020:00000080:1.0:1786400358.368137:0:8336:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1786400358.368142:0:8336:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1786400358.368149:0:8336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff76a65890 20000000:00000080:1.0:1786400358.368155:0:8336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9373bfd2a000 uarg=0000000000000000 20000000:01000000:1.0:1786400358.368203:0:8336:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1786400358.368205:0:8336:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1786400358.368208:0:8336:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1786400358.368213:0:8336:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1786400358.368218:0:8336:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1786400358.368232:0:8336:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786400358.368234:0:8336:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1786400358.368423:0:8336:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1786400358.368426:0:8336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1786400358.373980:0:8337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1786400358.377340:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1786400358.377406:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1786400358.377464:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1786400358.377479:0:8336:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1786400358.377482:0:8336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1786400358.385139:0:8338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1786400358.385897:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1786400358.386035:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1786400358.386075:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1786400358.386089:0:8336:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1786400358.386092:0:8336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1786400358.388220:0:8339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1786400358.388675:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1786400358.388765:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1786400358.388805:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1786400358.388822:0:8336:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1786400358.388825:0:8336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1786400358.391289:0:8340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1786400358.391822:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1786400358.391888:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1786400358.391946:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1786400358.391964:0:8336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786400358.391985:0:8336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392005:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392013:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392020:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a504c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392026:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a505a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392033:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392039:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392045:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392055:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392061:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392081:0:8336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392126:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392142:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 9 pid: 5810 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.392161:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392919424:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400358.392274:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392283:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 9 pid: 5811 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.392291:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392919552:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400358.392319:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392326:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 18 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.392335:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392919680:0@lo:104: 00000100:00100000:1.0:1786400358.392371:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400358.392414:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392919680 00000100:00100000:1.0:1786400358.392420:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392919680 00000100:00100000:1.0:1786400358.392466:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786400358.392480:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392919680:12345-0@lo:104: 00010000:00010000:1.0:1786400358.392493:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392540:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400358.392545:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392919680:12345-0@lo:104: Request processed in 67us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400358.392553:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1786400358.392581:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392588:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 18 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.392596:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392919808:0@lo:104: 00000100:00100000:1.0:1786400358.392618:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400358.392639:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786400358.392647:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392919808 00000100:00100000:1.0:1786400358.392650:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392919808 00000100:00100000:1.0:1786400358.392666:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786400358.392671:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b07fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392919808:12345-0@lo:104: 00010000:00010000:1.0:1786400358.392677:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392703:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786400358.392708:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b07fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392919808:12345-0@lo:104: Request processed in 37us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400358.392713:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1786400358.392765:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400358.392777:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392784:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4e00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400358.392787:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.392795:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400358.392802:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400358.392808:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400358.395979:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.395997:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400358.396027:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396034:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a50a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a50b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396051:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400358.396055:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396061:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763800 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400358.396064:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396088:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400358.396094:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400358.396099:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400358.396113:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396118:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400358.396132:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396138:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a5084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a508b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396146:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396148:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396149:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396195:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396206:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 18 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.396218:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392920192:0@lo:104: 00000100:00100000:1.0:1786400358.396275:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400358.396312:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392920192 00000100:00100000:1.0:1786400358.396323:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392920192 00000100:00100000:1.0:1786400358.396365:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786400358.396373:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392920192:12345-0@lo:104: 00010000:00010000:1.0:1786400358.396383:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396425:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400358.396431:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392920192:12345-0@lo:104: Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400358.396438:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1786400358.396456:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400358.396459:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396465:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4200 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400358.396469:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396475:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400358.396481:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400358.396486:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400358.396499:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396504:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400358.396509:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396523:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a5068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a506f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396533:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396535:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396536:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396558:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a505a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396566:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a505a expref: 18 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.396574:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392920448:0@lo:104: 00000100:00100000:1.0:1786400358.396597:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400358.396616:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392920448 00000100:00100000:1.0:1786400358.396620:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392920448 00000100:00100000:1.0:1786400358.396637:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786400358.396642:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392920448:12345-0@lo:104: 00010000:00010000:1.0:1786400358.396649:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396678:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400358.396683:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392920448:12345-0@lo:104: Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400358.396688:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1786400358.396702:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400358.396706:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396723:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763000 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400358.396726:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396733:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400358.396765:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400358.396770:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400358.396785:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396792:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400358.396798:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396804:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399763000/0x49554f35ff0a505a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5061 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396813:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396815:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396816:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.396839:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a504c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396860:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a504c expref: 18 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.396879:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392920704:0@lo:104: 00000100:00100000:1.0:1786400358.396901:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400358.396919:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392920704 00000100:00100000:1.0:1786400358.396923:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392920704 00000100:00100000:1.0:1786400358.396939:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786400358.396945:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392920704:12345-0@lo:104: 00010000:00010000:1.0:1786400358.396952:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.396981:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400358.396986:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392920704:12345-0@lo:104: Request processed in 42us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400358.396991:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1786400358.397003:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400358.397007:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397013:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030e00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400358.397016:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397023:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400358.397029:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400358.397035:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400358.397054:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397061:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400358.397065:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397070:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937380030e00/0x49554f35ff0a504c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5053 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397079:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.397081:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.397082:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.397103:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397111:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 18 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.397119:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392920960:0@lo:104: 00000100:00100000:1.0:1786400358.397142:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400358.397160:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392920960 00000100:00100000:1.0:1786400358.397163:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392920960 00000100:00100000:1.0:1786400358.397178:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786400358.397184:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392920960:12345-0@lo:104: 00010000:00010000:1.0:1786400358.397190:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397218:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400358.397223:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392920960:12345-0@lo:104: Request processed in 40us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400358.397234:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1786400358.397248:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400358.397252:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397257:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5000 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400358.397260:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397267:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400358.397272:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400358.397277:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400358.397290:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397296:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400358.397301:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397307:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5029 expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397317:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.397319:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.397320:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.397339:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397352:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 18 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400358.397361:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392921216:0@lo:104: 00000100:00100000:1.0:1786400358.397382:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400358.397400:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392921216 00000100:00100000:1.0:1786400358.397404:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392921216 00000100:00100000:1.0:1786400358.397422:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786400358.397428:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392921216:12345-0@lo:104: 00010000:00010000:1.0:1786400358.397435:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397465:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400358.397470:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8336:x1873176392921216:12345-0@lo:104: Request processed in 43us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400358.397476:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1786400358.397488:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400358.397492:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397498:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5800 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400358.397501:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397507:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400358.397513:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400358.397525:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400358.397537:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397542:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400358.397546:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397553:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a4ff8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4fff expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.397567:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.397568:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400358.397570:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400358.397581:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400358.397602:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392919680:0@lo:104: 00000100:00100000:1.0:1786400358.397611:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392919808:0@lo:104: 00000100:00100000:1.0:1786400358.397619:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392920192:0@lo:104: 00000100:00100000:1.0:1786400358.397625:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392920448:0@lo:104: 00000100:00100000:1.0:1786400358.397630:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392920704:0@lo:104: 00000100:00100000:1.0:1786400358.397635:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392920960:0@lo:104: 00000100:00100000:1.0:1786400358.397642:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392921216:0@lo:104: 00000100:00100000:0.0:1786400358.398183:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392920576:0@lo:103: 00000100:00100000:0.0:1786400358.398219:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400358.398249:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786400358.398255:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392919936:0@lo:103: 00000100:00100000:0.0:1786400358.398276:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400358.398291:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392920832:0@lo:103: 00000100:00100000:0.0:1786400358.398309:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400358.398338:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392920064:0@lo:103: 00000100:00100000:0.0:1786400358.398358:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400358.398377:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392921088:0@lo:103: 00000100:00100000:0.0:1786400358.398396:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400358.398407:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786400358.398412:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392920320:0@lo:103: 00000100:00100000:0.0:1786400358.398429:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400358.398439:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392921344:0@lo:103: 00000100:00100000:0.0:1786400358.398457:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400358.398476:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392920576 00000100:00100000:0.0:1786400358.398480:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392920576 00010000:00010000:0.0:1786400358.398502:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a505a expref: 19 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400358.398520:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392919936 00000100:00100000:0.0:1786400358.398522:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392919936 00010000:00010000:0.0:1786400358.398533:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 20 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400358.398543:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392920832 00000100:00100000:0.0:1786400358.398545:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392920832 00010000:00010000:0.0:1786400358.398567:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a504c expref: 21 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400358.398579:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392920064 00000100:00100000:0.0:1786400358.398581:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392920064 00010000:00010000:0.0:1786400358.398591:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 22 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400358.398600:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392921088 00000100:00100000:0.0:1786400358.398603:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392921088 00010000:00010000:0.0:1786400358.398610:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 23 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400358.398630:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392920320 00000100:00100000:0.0:1786400358.398632:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392920320 00010000:00010000:0.0:1786400358.398642:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 24 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400358.398649:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392921344 00000100:00100000:0.0:1786400358.398651:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392921344 00010000:00010000:0.0:1786400358.398659:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 25 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400358.398670:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786400358.398676:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+25:3315:x1873176392920576:12345-0@lo:103: 00010000:00010000:0.0:1786400358.398687:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400358.398692:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a505a expref: 25 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398700:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a505a expref: 25 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398715:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380031800/0x49554f35ff0a5061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a505a expref: 25 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398727:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400358.398774:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+24:3315:x1873176392920576:12345-0@lo:103: Request processed in 98us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400358.398781:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786400358.398794:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786400358.398799:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+23:3315:x1873176392919936:12345-0@lo:103: 00010000:00010000:0.0:1786400358.398814:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400358.398819:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 23 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398827:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 23 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398835:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399763e00/0x49554f35ff0a50b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a50a7 expref: 23 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398844:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400358.398875:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+22:3315:x1873176392919936:12345-0@lo:103: Request processed in 76us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400358.398882:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786400358.398894:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400358.398900:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+21:3315:x1873176392920832:12345-0@lo:103: 00010000:00010000:0.0:1786400358.398912:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400358.398917:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a504c expref: 21 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398925:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a504c expref: 21 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398935:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f5c00/0x49554f35ff0a5053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a504c expref: 21 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.398944:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400358.398965:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+20:3315:x1873176392920832:12345-0@lo:103: Request processed in 65us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400358.398979:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400358.398991:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400358.398997:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392920064:12345-0@lo:103: 00010000:00010000:0.0:1786400358.399004:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400358.399009:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 19 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399017:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 19 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399026:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399763200/0x49554f35ff0a508b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a5084 expref: 19 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399033:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400358.399057:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:3317:x1873176392920064:12345-0@lo:103: Request processed in 61us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400358.399063:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400358.399075:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786400358.399080:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3317:x1873176392921088:12345-0@lo:103: 00010000:00010000:0.0:1786400358.399087:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400358.399090:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 17 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399098:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 17 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399106:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399763400/0x49554f35ff0a5029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a5022 expref: 17 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399124:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400358.399145:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3317:x1873176392921088:12345-0@lo:103: Request processed in 65us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400358.399150:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786400358.399161:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786400358.399166:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:3317:x1873176392920320:12345-0@lo:103: 00010000:00010000:0.0:1786400358.399174:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400358.399178:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 15 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399185:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 15 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399194:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380030400/0x49554f35ff0a506f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a5068 expref: 15 pid: 5809 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399203:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400358.399222:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:3317:x1873176392920320:12345-0@lo:103: Request processed in 56us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400358.399228:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786400358.399240:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786400358.399245:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:3317:x1873176392921344:12345-0@lo:103: 00010000:00010000:0.0:1786400358.399252:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400358.399256:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 13 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399263:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 13 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399277:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a4fff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4ff8 expref: 13 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.399285:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400358.399306:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:3317:x1873176392921344:12345-0@lo:103: Request processed in 61us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400358.399312:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786400358.399368:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392919936:0@lo:103: 00000100:00100000:0.0:1786400358.399378:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392920832:0@lo:103: 00000100:00100000:0.0:1786400358.399384:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392920576:0@lo:103: 00000100:00100000:0.0:1786400358.399411:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392920320:0@lo:103: 00000100:00100000:0.0:1786400358.399418:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392921344:0@lo:103: 00000100:00100000:0.0:1786400358.399424:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392920064:0@lo:103: 00000100:00100000:0.0:1786400358.399430:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392921088:0@lo:103: 00010000:00010000:2.0:1786400358.400824:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400358.402120:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392919424:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400358.402134:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1873176392919552:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400358.402178:0:8336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400358.406811:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400358.406890:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368779264 00000100:00100000:0.0:1786400358.406900:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368779264 00010000:00010000:0.0:1786400358.406938:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 10 pid: 5810 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400358.406981:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:0.0:1786400358.406991:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2361:x1873176368779264:12345-192.168.201.23@tcp:103: 00010000:00010000:0.0:1786400358.407005:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400358.407012:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 10 pid: 5810 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.407030:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 10 pid: 5810 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.407047:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380031a00/0x49554f35ff0a50ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f7d expref: 10 pid: 5810 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.407064:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400358.407115:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:2361:x1873176368779264:12345-192.168.201.23@tcp:103: Request processed in 125us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400358.407123:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:0.0:1786400358.407939:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400358.407997:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368779392 00000100:00100000:3.0:1786400358.408002:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368779392 00010000:00010000:3.0:1786400358.408022:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 9 pid: 5811 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400358.408048:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:3.0:1786400358.408055:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:2361:x1873176368779392:12345-192.168.201.23@tcp:103: 00010000:00010000:3.0:1786400358.408065:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400358.408076:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 9 pid: 5811 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408087:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 9 pid: 5811 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408099:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380031000/0x49554f35ff0a50c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4f76 expref: 9 pid: 5811 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408111:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408119:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408134:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408141:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408149:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408155:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408161:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4c00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:3.0:1786400358.408166:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408173:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408195:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400358.408205:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400358.408231:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:2361:x1873176368779392:12345-192.168.201.23@tcp:103: Request processed in 177us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400358.408237:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00010000:00010000:1.0:1786400358.411684:0:8336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.411701:0:8336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400358.411708:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a5102 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400358.548154:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400359.576098:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400359.715243:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400359.715463:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368779520 00000100:00100000:2.0:1786400359.715474:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368779520 00000100:00100000:2.0:1786400359.715535:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 132 00000100:00100000:2.0:1786400359.715545:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:2361:x1873176368779520:12345-192.168.201.23@tcp:400: 00000100:00100000:2.0:1786400359.715788:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:2361:x1873176368779520:12345-192.168.201.23@tcp:400: Request processed in 244us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400359.715797:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 132 00000100:00100000:0.0:1786400359.724114:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400359.724271:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400359.724307:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400359.724368:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368779776 00000100:00100000:1.0:1786400359.724379:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368779776 00000100:00100000:1.0:1786400359.724441:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368779904 00000100:00100000:1.0:1786400359.724445:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368779904 00000100:00100000:1.0:1786400359.724464:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:1.0:1786400359.724474:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368779776:12345-192.168.201.23@tcp:400: 00000100:00100000:2.0:1786400359.724541:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368779648 00000100:00100000:2.0:1786400359.724546:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368779648 00000100:00100000:1.0:1786400359.724553:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368779776:12345-192.168.201.23@tcp:400: Request processed in 79us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400359.724561:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:1.0:1786400359.724580:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:1.0:1786400359.724589:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368779904:12345-192.168.201.23@tcp:400: 00000100:00100000:2.0:1786400359.724619:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:1.0:1786400359.724620:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368779904:12345-192.168.201.23@tcp:400: Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400359.724632:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1786400359.724633:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368779648:12345-192.168.201.23@tcp:400: 00000100:00080000:1.0:1786400359.724665:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786400359.724671:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400359.724674:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368779648:12345-192.168.201.23@tcp:400: Request processed in 45us (568us total) trans 0 rc 0/0 00000100:00080000:1.0:1786400359.724675:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400359.724686:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 10000000:01000000:0.0:1786400360.274931:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786400360.274940:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373bf25e800 from 39 10000000:01000000:0.0:1786400360.274947:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786400360.275002:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.275014:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.275025:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400360.275050:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392921472:0@lo:101: 00000100:00100000:0.0:1786400360.275138:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.275211:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.275255:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392921472 00000100:00100000:2.0:1786400360.275265:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392921472 00000100:00100000:2.0:1786400360.275332:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1786400360.275420:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+12:5813:x1873176392921472:12345-0@lo:101: 00010000:00010000:2.0:1786400360.275438:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400360.275460:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a5110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5109 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.275487:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a5110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5109 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.275499:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a5110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5109 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.275509:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fc400, rc 0) 00000100:00100000:2.0:1786400360.275562:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392921472:12345-0@lo:101: Request processed in 220us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.275569:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1786400360.275957:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392921472:0@lo:101: 00010000:00010000:0.0:1786400360.275975:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.275985:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400360.276053:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392921600:0@lo:501: 00000100:00100000:0.0:1786400360.276081:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.276111:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.276164:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392921600 00000100:00100000:2.0:1786400360.276169:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392921600 00000100:00100000:2.0:1786400360.276202:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1786400360.276210:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392921600:12345-0@lo:501: 00000100:00100000:2.0:1786400360.276596:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392921600:12345-0@lo:501: Request processed in 385us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.276603:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1786400360.294504:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392921600:0@lo:501: 00000100:00100000:0.0:1786400360.294573:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392921728:0@lo:503: 00000100:00100000:0.0:1786400360.294665:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.294721:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.295823:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392921728 00000100:00100000:1.0:1786400360.295842:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392921728 00000100:00100000:1.0:1786400360.295902:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1786400360.295913:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392921728:12345-0@lo:503: 00000100:00100000:1.0:1786400360.296159:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392921728:12345-0@lo:503: Request processed in 247us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.296167:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1786400360.296247:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392921728:0@lo:503: 00000100:00100000:3.0:1786400360.297062:0:8352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8352:1873176392921856:0@lo:502: 00000100:00100000:3.0:1786400360.297114:0:8352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.297669:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392921856 00000100:00100000:2.0:1786400360.297676:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392921856 00000100:00100000:2.0:1786400360.297734:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1786400360.297774:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:8352:x1873176392921856:12345-0@lo:502: 00000100:00100000:3.0:1786400360.298156:0:8352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372600 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.298353:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:8352:x1873176392921856:12345-0@lo:502: Request processed in 580us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.298361:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1786400360.298442:0:8352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8352:1873176392921856:0@lo:502: 00000100:00100000:3.0:1786400360.298492:0:8352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8352:1873176392921984:0@lo:502: 00000100:00100000:3.0:1786400360.298528:0:8352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400360.298602:0:8352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372600 going to sleep for 11 seconds 00000100:00100000:0.0:1786400360.298640:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392921984 00000100:00100000:0.0:1786400360.298645:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392921984 00000100:00100000:0.0:1786400360.298732:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1786400360.298763:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:8352:x1873176392921984:12345-0@lo:502: 00000100:00100000:0.0:1786400360.299343:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+13:8352:x1873176392921984:12345-0@lo:502: Request processed in 602us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400360.299350:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1786400360.299567:0:8352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8352:1873176392921984:0@lo:502: 00000040:00080000:3.0:1786400360.299596:0:8352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1786400360.300053:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1786400360.300075:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786400360.300086:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.300098:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400360.300108:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1786400360.300110:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1786400360.300113:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1786400360.300144:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.300225:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.300235:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400360.300254:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922112:0@lo:101: 00000100:00100000:1.0:1786400360.300296:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.305058:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8480 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.305242:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392922112 00000100:00100000:2.0:1786400360.305251:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392922112 00000100:00100000:2.0:1786400360.305371:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1786400360.305381:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+13:5813:x1873176392922112:12345-0@lo:101: 00010000:00010000:2.0:1786400360.305396:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400360.305413:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a511e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5117 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.305440:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a511e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5117 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.305451:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a511e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5117 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.305458:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fc800, rc 0) 00000100:00100000:2.0:1786400360.305564:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392922112:12345-0@lo:101: Request processed in 184us (5266us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.305570:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1786400360.305716:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922112:0@lo:101: 00010000:00010000:3.0:1786400360.305733:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400360.309266:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400360.309422:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922240:0@lo:501: 00000100:00100000:3.0:1786400360.309505:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400360.309556:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372600 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.310008:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392922240 00000100:00100000:1.0:1786400360.310023:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392922240 00000100:00100000:1.0:1786400360.310071:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1786400360.310080:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392922240:12345-0@lo:501: 00000100:00100000:1.0:1786400360.310775:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392922240:12345-0@lo:501: Request processed in 694us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.310784:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1786400360.310857:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922240:0@lo:501: 00000100:00100000:1.0:1786400360.311021:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922368:0@lo:503: 00000100:00100000:1.0:1786400360.311063:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.311089:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.311102:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392922368 00000100:00100000:1.0:1786400360.311106:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392922368 00000100:00100000:1.0:1786400360.311127:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1786400360.311132:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392922368:12345-0@lo:503: 00000100:00100000:1.0:1786400360.311330:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392922368:12345-0@lo:503: Request processed in 197us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.311337:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1786400360.311371:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922368:0@lo:503: 00000100:00100000:1.0:1786400360.311542:0:8353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8353:1873176392922496:0@lo:502: 00000100:00100000:1.0:1786400360.311574:0:8353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.311590:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392922496 00000100:00100000:1.0:1786400360.311594:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392922496 00000100:00100000:1.0:1786400360.311609:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1786400360.311615:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:8353:x1873176392922496:12345-0@lo:502: 00000100:00100000:1.0:1786400360.311724:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:8353:x1873176392922496:12345-0@lo:502: Request processed in 108us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.311759:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1786400360.311784:0:8353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8180 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.312488:0:8353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8353:1873176392922496:0@lo:502: 00000020:01000000:1.0:1786400360.312519:0:8353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400360.312529:0:8353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400360.312531:0:8353:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786400360.312537:0:8353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1786400360.312565:0:8353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8353:1873176392922624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400360.312607:0:8353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.312634:0:8353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8180 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.314259:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392922624 00000100:00100000:2.0:1786400360.314272:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392922624 00000100:00100000:2.0:1786400360.314366:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1786400360.314379:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:8353:x1873176392922624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400360.314627:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:8353:x1873176392922624:12345-0@lo:502:llog_process_th.0 Request processed in 250us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.314634:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1786400360.314847:0:8353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8353:1873176392922624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400360.314890:0:8353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400360.314897:0:8353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400360.314900:0:8353:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786400360.314904:0:8353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1786400360.315176:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1786400360.315196:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1786400360.315206:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.315225:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400360.315235:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786400360.315237:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373b7b4b000 from 39 10000000:01000000:0.0:1786400360.315240:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786400360.315269:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.315277:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.315285:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400360.315304:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.315350:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.321716:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400360.321987:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392922752 00000100:00100000:3.0:1786400360.321996:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392922752 00000100:00100000:2.0:1786400360.322072:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786400360.322086:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:5813:x1873176392922752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400360.322102:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400360.322119:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fce00/0x49554f35ff0a512c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5125 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.322176:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fce00/0x49554f35ff0a512c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5125 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.322188:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fce00/0x49554f35ff0a512c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5125 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.322197:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fce00, rc 0) 00000100:00100000:2.0:1786400360.322252:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392922752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (6901us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.322259:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1786400360.322346:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400360.322364:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.322374:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400360.322440:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.322474:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.328770:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.328991:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392922880 00000100:00100000:1.0:1786400360.329000:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392922880 00000100:00100000:1.0:1786400360.329051:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1786400360.329060:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392922880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.329629:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392922880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 568us (7152us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.329637:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1786400360.329785:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392922880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.329857:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392923008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.329915:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.329940:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.330117:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392923008 00000100:00100000:1.0:1786400360.330122:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392923008 00000100:00100000:1.0:1786400360.330143:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1786400360.330216:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392923008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.330705:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392923008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 555us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.330712:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1786400360.330956:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392923008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.331516:0:8354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8354:1873176392923136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400360.331558:0:8354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.331623:0:8354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa780 going to sleep for 11 seconds 00000100:00100000:3.0:1786400360.331689:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392923136 00000100:00100000:3.0:1786400360.331696:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392923136 00000100:00100000:2.0:1786400360.331763:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1786400360.331774:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:8354:x1873176392923136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400360.333601:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+15:8354:x1873176392923136:12345-0@lo:502:llog_process_th.0 Request processed in 1823us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.333611:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1786400360.333700:0:8354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8354:1873176392923136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400360.333770:0:8354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8354:1873176392923264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400360.333830:0:8354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.338062:0:8354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a9923900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.341057:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392923264 00000100:00100000:1.0:1786400360.341071:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392923264 00000100:00100000:1.0:1786400360.341134:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1786400360.341144:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:8354:x1873176392923264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400360.342380:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+15:8354:x1873176392923264:12345-0@lo:502:llog_process_th.0 Request processed in 1184us (8496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.342389:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786400360.342618:0:8354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8354:1873176392923264:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786400360.342653:0:8354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1786400360.343028:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1786400360.343046:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786400360.343056:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.343067:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400360.343078:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1786400360.343080:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1786400360.343083:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786400360.343114:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.343123:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.343132:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400360.343228:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392923392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.343268:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.343306:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1786400360.343401:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392923392 00000100:00100000:3.0:1786400360.343407:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392923392 00000100:00100000:3.0:1786400360.343449:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786400360.343457:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+15:5813:x1873176392923392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400360.343469:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400360.343481:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399762c00/0x49554f35ff0a513a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5133 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400360.343505:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399762c00/0x49554f35ff0a513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5133 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400360.343517:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399762c00/0x49554f35ff0a513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5133 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400360.343526:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762c00, rc 0) 00000100:00100000:3.0:1786400360.343570:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392923392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400360.343576:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1786400360.343648:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392923392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400360.343661:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.343670:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400360.343711:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392923520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400360.343736:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.343788:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392923520 00000100:00100000:2.0:1786400360.343938:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392923520 00000100:00100000:2.0:1786400360.343961:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1786400360.343967:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392923520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400360.344257:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392923520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.344265:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1786400360.344289:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.344300:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392923520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400360.344427:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392923648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400360.344464:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.344483:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392923648 00000100:00100000:2.0:1786400360.344487:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392923648 00000100:00100000:2.0:1786400360.344504:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1786400360.344510:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392923648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400360.344630:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392923648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.344636:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1786400360.344659:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.344668:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392923648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.347781:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392924032:0@lo:400:kworker.0 00000100:00100000:0.0:1786400360.347985:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.348030:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400360.348037:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392924160:0@lo:400:kworker.0 00000100:00100000:0.0:1786400360.348063:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.348097:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392924032 00000100:00100000:0.0:1786400360.348105:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392924032 00000100:00100000:0.0:1786400360.348237:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400360.348248:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392924032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400360.348301:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392924032:12345-0@lo:400:kworker.0 Request processed in 54us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400360.348336:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400360.348361:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392924160 00000100:00100000:0.0:1786400360.348365:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392924160 00000100:00100000:0.0:1786400360.348391:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786400360.348398:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392924160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400360.348429:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392924160:12345-0@lo:400:kworker.0 Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400360.348435:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1786400360.348450:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400360.348454:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400360.348489:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392924160:0@lo:400:kworker.0 00010000:00080000:0.0:1786400360.348503:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e38a80 x1873176392924032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400360.348514:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392924032:0@lo:400:kworker.0 00000100:00100000:2.0:1786400360.348709:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392923904:0@lo:400:kworker.0 00000100:00100000:2.0:1786400360.348751:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.348779:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786400360.348786:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392923776:0@lo:400:kworker.0 00000100:00100000:2.0:1786400360.348825:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.348843:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392924288:0@lo:400:kworker.0 00000100:00100000:2.0:1786400360.348998:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.349026:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392923904 00000100:00100000:2.0:1786400360.349030:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392923904 00000100:00100000:2.0:1786400360.349057:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392923776 00000100:00100000:2.0:1786400360.349060:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392923776 00000100:00100000:2.0:1786400360.349076:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786400360.349082:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392923904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400360.349128:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392923904:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.349135:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786400360.349158:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786400360.349165:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392923776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400360.349190:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392923776:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.349196:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786400360.349219:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392923776:0@lo:400:kworker.0 00000100:00100000:2.0:1786400360.349228:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392923904:0@lo:400:kworker.0 00000100:00100000:0.0:1786400360.349732:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392924288 00000100:00100000:0.0:1786400360.349770:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392924288 00000100:00100000:0.0:1786400360.349810:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786400360.349826:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392924288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400360.349867:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392924288:12345-0@lo:400:kworker.0 Request processed in 42us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400360.350014:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1786400360.350036:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400360.350040:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786400360.350068:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e38700 x1873176392924288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400360.350078:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392924288:0@lo:400:kworker.0 00000100:00100000:3.0:1786400360.350544:0:8355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8355:1873176392924416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400360.350593:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400360.350670:0:8355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372780 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.350705:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392924416 00000100:00100000:2.0:1786400360.350709:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392924416 00000100:00100000:2.0:1786400360.355972:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1786400360.356003:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:8355:x1873176392924416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400360.356343:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:8355:x1873176392924416:12345-0@lo:502:llog_process_th.0 Request processed in 355us (5748us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.356351:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1786400360.356482:0:8355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8355:1873176392924416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400360.356514:0:8355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400360.356524:0:8355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400360.356526:0:8355:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786400360.356533:0:8355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1786400360.356568:0:8355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8355:1873176392924544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400360.356613:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.356653:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392924544 00000100:00100000:1.0:1786400360.356657:0:8355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.356661:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392924544 00000100:00100000:2.0:1786400360.356709:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1786400360.356715:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:8355:x1873176392924544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400360.359385:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:8355:x1873176392924544:12345-0@lo:502:llog_process_th.0 Request processed in 2661us (2763us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.359401:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1786400360.359680:0:8355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8355:1873176392924544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400360.359711:0:8355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400360.359718:0:8355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400360.359720:0:8355:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786400360.359726:0:8355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1786400360.359946:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1786400360.359963:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786400360.359972:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.359983:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400360.359994:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786400360.359996:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373910fb800 from 39 10000000:01000000:2.0:1786400360.359999:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786400360.360031:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.360039:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.360047:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400360.360068:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392924672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786400360.360103:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.360153:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1786400360.360252:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392924672 00000100:00100000:0.0:1786400360.360259:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392924672 00000100:00100000:0.0:1786400360.360299:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1786400360.360308:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392924672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400360.360319:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400360.360342:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380031a00/0x49554f35ff0a5148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5141 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.360365:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380031a00/0x49554f35ff0a5148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5141 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.360375:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380031a00/0x49554f35ff0a5148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5141 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.360383:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031a00, rc 0) 00000100:00100000:0.0:1786400360.360457:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392924672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400360.360464:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1786400360.362324:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392924672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400360.362460:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.362472:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400360.371062:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392924800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.371137:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.371330:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a99239c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.371504:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392924800 00000100:00100000:1.0:1786400360.371513:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392924800 00000100:00100000:1.0:1786400360.371562:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1786400360.371571:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392924800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.371868:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392924800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.371876:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1786400360.371969:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392924800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.372009:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392924928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.372048:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400360.372105:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a99239c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400360.376012:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392924928 00000100:00100000:3.0:1786400360.376027:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392924928 00000100:00100000:3.0:1786400360.376094:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1786400360.376104:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392924928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400360.376504:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392924928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 401us (4454us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400360.376513:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1786400360.377101:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392924928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400360.377597:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8356:1873176392925056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400360.377652:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.377736:0:8356:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.377853:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392925056 00000100:00100000:1.0:1786400360.377859:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392925056 00000100:00100000:1.0:1786400360.377953:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1786400360.377968:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:8356:x1873176392925056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400360.378266:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:8356:x1873176392925056:12345-0@lo:502:llog_process_th.0 Request processed in 299us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.378274:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1786400360.378348:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8356:1873176392925056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400360.378390:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8356:1873176392925184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400360.378422:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400360.379159:0:8356:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390910480 going to sleep for 11 seconds 00000100:00100000:3.0:1786400360.379274:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392925184 00000100:00100000:3.0:1786400360.379281:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392925184 00000100:00100000:3.0:1786400360.379312:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786400360.379318:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:8356:x1873176392925184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400360.379551:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:8356:x1873176392925184:12345-0@lo:502:llog_process_th.0 Request processed in 232us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400360.379559:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1786400360.379649:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8356:1873176392925184:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786400360.379673:0:8356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1786400360.379837:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1786400360.379855:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786400360.379867:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.379879:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400360.379888:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1786400360.379891:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1786400360.379894:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786400360.379919:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.379927:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.379936:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400360.379954:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392925312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.379984:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.380109:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1786400360.380495:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392925312 00000100:00100000:0.0:1786400360.380501:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392925312 00000100:00100000:3.0:1786400360.380547:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1786400360.380555:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392925312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400360.380565:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400360.380576:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399762400/0x49554f35ff0a5156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a514f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400360.380597:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399762400/0x49554f35ff0a5156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a514f expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400360.380607:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399762400/0x49554f35ff0a5156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a514f expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400360.380615:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762400, rc 0) 00000100:00100000:3.0:1786400360.380662:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392925312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400360.380668:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1786400360.380735:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392925312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400360.380786:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.380795:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400360.380852:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392925440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.380877:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.380896:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.381090:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392925440 00000100:00100000:2.0:1786400360.381095:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392925440 00000100:00100000:2.0:1786400360.381126:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1786400360.381133:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392925440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400360.381474:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392925440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.381481:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1786400360.381541:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392925440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.381568:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392925568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.381601:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.381628:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1786400360.381664:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392925568 00000100:00100000:3.0:1786400360.381669:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392925568 00000100:00100000:3.0:1786400360.381695:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786400360.381701:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392925568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400360.381879:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392925568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400360.381885:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1786400360.382371:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392925568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400360.382692:0:8357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8357:1873176392925696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400360.382733:0:8357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400360.382788:0:8357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372180 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.382847:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392925696 00000100:00100000:1.0:1786400360.382853:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392925696 00000100:00100000:1.0:1786400360.382881:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1786400360.382888:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:8357:x1873176392925696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400360.383136:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:8357:x1873176392925696:12345-0@lo:502:llog_process_th.0 Request processed in 249us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.383143:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1786400360.383348:0:8357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8357:1873176392925696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786400360.383371:0:8357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400360.383380:0:8357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400360.383383:0:8357:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786400360.383389:0:8357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1786400360.383408:0:8357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8357:1873176392925824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400360.383441:0:8357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400360.383467:0:8357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372180 going to sleep for 11 seconds 00000100:00100000:1.0:1786400360.383512:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392925824 00000100:00100000:1.0:1786400360.383517:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392925824 00000100:00100000:1.0:1786400360.383545:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1786400360.383552:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:8357:x1873176392925824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400360.383725:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:8357:x1873176392925824:12345-0@lo:502:llog_process_th.0 Request processed in 173us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400360.383732:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1786400360.383946:0:8357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8357:1873176392925824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786400360.383963:0:8357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400360.383967:0:8357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400360.383969:0:8357:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1786400360.383972:0:8357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1786400360.384188:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1786400360.384209:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786400360.384219:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.384282:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400360.384295:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1786400360.384297:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9373a0c50000 from 1 10000000:01000000:1.0:1786400360.384300:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786400360.384323:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.384332:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.384341:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400360.384356:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392925952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.384386:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.384450:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400360.384483:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392925952 00000100:00100000:2.0:1786400360.384488:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392925952 00000100:00100000:2.0:1786400360.384558:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1786400360.384567:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392925952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400360.384584:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400360.384595:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fca00/0x49554f35ff0a5164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a515d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.384617:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fca00/0x49554f35ff0a5164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a515d expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.384629:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fca00/0x49554f35ff0a5164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a515d expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400360.384637:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fca00, rc 0) 00000100:00100000:2.0:1786400360.384676:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392925952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400360.384682:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1786400360.384732:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392925952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400360.384767:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5164 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.384782:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5164 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400360.384828:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392926080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400360.384849:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400360.385026:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400360.385130:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392926080 00000100:00100000:0.0:1786400360.385135:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392926080 00000100:00100000:0.0:1786400360.385156:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1786400360.385163:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392926080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400360.385415:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392926080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (564us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400360.385423:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1786400360.385499:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392926080:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1786400360.385521:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786400360.385528:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5164 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400360.385536:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5164 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.595610:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400360.851122:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400360.851145:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392926208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400360.851210:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400360.851439:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392926208 00000100:00100000:3.0:1786400360.851461:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392926208 00000100:00100000:3.0:1786400360.851518:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786400360.851528:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392926208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400360.851563:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400360.851622:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392926208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400360.851630:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1786400360.851772:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884c700 x1873176392926208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400360.851803:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392926208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400360.994993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400360.995234:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368780032 00000100:00100000:0.0:1786400360.995245:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368780032 00000100:00100000:0.0:1786400360.995306:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 165 00000100:00100000:0.0:1786400360.995338:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:5580:x1873176368780032:12345-192.168.201.23@tcp:101: 00010000:00010000:0.0:1786400360.995357:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400360.995377:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380031000/0x49554f35ff0a516b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4fdf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.995408:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380031000/0x49554f35ff0a516b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fdf expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.995420:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380031000/0x49554f35ff0a516b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fdf expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400360.995448:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031000, rc 0) 00000100:00100000:0.0:1786400360.995516:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5580:x1873176368780032:12345-192.168.201.23@tcp:101: Request processed in 191us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400360.995523:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 165 00000100:00100000:1.0:1786400361.006719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400361.006852:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368780160 00000100:00100000:3.0:1786400361.006872:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368780160 00000100:00100000:3.0:1786400361.006924:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 166 00000100:00100000:3.0:1786400361.006934:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5580:x1873176368780160:12345-192.168.201.23@tcp:501: 00000100:00100000:3.0:1786400361.007253:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5580:x1873176368780160:12345-192.168.201.23@tcp:501: Request processed in 319us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400361.007261:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 166 00000100:00100000:1.0:1786400361.022000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400361.022199:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368780288 00000100:00100000:2.0:1786400361.022209:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368780288 00000100:00100000:2.0:1786400361.022269:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 167 00000100:00100000:2.0:1786400361.022278:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5580:x1873176368780288:12345-192.168.201.23@tcp:503: 00000100:00100000:2.0:1786400361.022525:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5580:x1873176368780288:12345-192.168.201.23@tcp:503: Request processed in 246us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400361.022534:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 167 00000100:00100000:3.0:1786400361.025675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400361.026333:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368780416 00000100:00100000:0.0:1786400361.026345:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368780416 00000100:00100000:0.0:1786400361.026415:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 168 00000100:00100000:0.0:1786400361.026425:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:6060:x1873176368780416:12345-192.168.201.23@tcp:502: 00000100:00100000:0.0:1786400361.026813:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:6060:x1873176368780416:12345-192.168.201.23@tcp:502: Request processed in 379us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400361.026822:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 168 00000100:00100000:0.0:1786400361.030847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400361.030958:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368780544 00000100:00100000:1.0:1786400361.030970:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368780544 00000100:00100000:1.0:1786400361.031043:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 169 00000100:00100000:1.0:1786400361.031055:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:6060:x1873176368780544:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400361.031364:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:6060:x1873176368780544:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 309us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400361.031383:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 169 00000100:00100000:1.0:1786400361.039728:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400361.042487:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368780672 00000100:00100000:3.0:1786400361.042502:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368780672 00000100:00100000:3.0:1786400361.042587:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 170 00000100:00100000:3.0:1786400361.042597:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5580:x1873176368780672:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400361.042615:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400361.042631:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399762800/0x49554f35ff0a5172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4fe6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400361.042659:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399762800/0x49554f35ff0a5172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fe6 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400361.042670:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399762800/0x49554f35ff0a5172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fe6 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400361.042694:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762800, rc 0) 00000100:00100000:3.0:1786400361.042778:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5580:x1873176368780672:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 182us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400361.042786:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 170 00000100:00100000:0.0:1786400361.053452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400361.053775:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368780800 00000100:00100000:3.0:1786400361.054146:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368780800 00000100:00100000:3.0:1786400361.054218:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 171 00000100:00100000:3.0:1786400361.054229:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5580:x1873176368780800:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400361.054731:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5580:x1873176368780800:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 502us (1288us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786400361.054770:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 171 00010000:00010000:2.0:1786400361.619277:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400361.875042:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392926336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400361.875123:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400361.875299:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392926336 00000100:00100000:3.0:1786400361.875308:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392926336 00000100:00100000:3.0:1786400361.875358:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400361.875367:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392926336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400361.875401:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400361.875448:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392926336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400361.875455:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1786400361.875559:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e38700 x1873176392926336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400361.875578:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392926336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786400362.645007:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786400362.728100:0:8394:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff63de0f20 00000020:00000080:3.0:1786400362.728117:0:8394:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1786400362.728121:0:8394:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1786400362.728130:0:8394:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff63de31b0 20000000:00000080:3.0:1786400362.728137:0:8394:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9372819da400 uarg=0000000000000000 20000000:01000000:3.0:1786400362.728173:0:8394:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786400362.728184:0:8394:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786400362.728189:0:8394:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1786400362.731312:0:8395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1786400362.733196:0:8394:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1786400362.746102:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1786400362.746197:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1786400362.746270:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1786400362.746290:0:8394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786400362.746311:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.746330:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380030c00/0x49554f35ff0a4eee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.746339:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.746346:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.746355:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.746363:0:8394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.746405:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.746421:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 9 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400362.746435:0:8394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8394:1873176392926464:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400362.746538:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.746561:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 18 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400362.746570:0:8394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8394:1873176392926592:0@lo:104: 00000100:00100000:2.0:1786400362.746611:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400362.747105:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.747113:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 18 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400362.747121:0:8394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8394:1873176392926720:0@lo:104: 00000100:00100000:2.0:1786400362.747145:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400362.751678:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380030c00/0x49554f35ff0a4eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.751694:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937380030c00/0x49554f35ff0a4eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 18 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400362.751708:0:8394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8394:1873176392926848:0@lo:104: 00000100:00100000:2.0:1786400362.751765:0:8394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400362.752027:0:8394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8394:1873176392926464:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400362.752255:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786400362.752278:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400362.752291:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392926592 00000100:00100000:3.0:1786400362.752297:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392926592 00000100:00100000:3.0:1786400362.752333:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392926720 00000100:00100000:3.0:1786400362.752336:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392926720 00000100:00100000:3.0:1786400362.752348:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392926848 00000100:00100000:3.0:1786400362.752350:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392926848 00000100:00100000:3.0:1786400362.752363:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786400362.752372:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+5:8394:x1873176392926592:12345-0@lo:104: 00010000:00010000:3.0:1786400362.752384:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752449:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400362.752456:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+5:8394:x1873176392926592:12345-0@lo:104: Request processed in 85us (5844us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400362.752463:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786400362.752481:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786400362.752488:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+4:8394:x1873176392926720:12345-0@lo:104: 00010000:00010000:3.0:1786400362.752501:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752532:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786400362.752537:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+4:8394:x1873176392926720:12345-0@lo:104: Request processed in 50us (5392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400362.752543:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786400362.752585:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786400362.752591:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8394:x1873176392926848:12345-0@lo:104: 00010000:00010000:3.0:1786400362.752599:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752625:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1786400362.752630:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:8394:x1873176392926848:12345-0@lo:104: Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400362.752636:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1786400362.752652:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786400362.752658:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752665:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400362.752669:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752677:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400362.752683:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400362.752689:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786400362.752717:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752725:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400362.752782:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752800:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937380031e00/0x49554f35ff0a5014 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a501b expref: -99 pid: 7520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752814:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786400362.752817:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752822:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763c00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400362.752826:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752833:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400362.752839:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400362.752844:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786400362.752859:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752864:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400362.752876:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752882:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399763c00/0x49554f35ff0a4f49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4f50 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752891:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400362.752900:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752906:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fc000 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400362.752909:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752915:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400362.752920:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400362.752925:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786400362.752939:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752945:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400362.752951:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752956:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c21fc000/0x49554f35ff0a4ee7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a4eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.752969:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400362.752971:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400362.752973:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400362.752985:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392926976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400362.753016:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400362.753057:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392926976 00000100:00100000:3.0:1786400362.753061:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392926976 00010000:00010000:3.0:1786400362.753084:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 19 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400362.753104:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786400362.753110:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392926976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400362.753121:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400362.753125:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 19 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.753134:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 19 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400362.753148:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400362.753175:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392926976:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400362.753181:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786400362.753210:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392926976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400362.753409:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:2.0:1786400362.753491:0:8394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a501b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a5014 expref: 18 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400362.753500:0:8394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8394:1873176392926592:0@lo:104: 00000100:00100000:2.0:1786400362.753509:0:8394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8394:1873176392926720:0@lo:104: 00000100:00100000:2.0:1786400362.753525:0:8394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8394:1873176392926848:0@lo:104: 00010000:00010000:2.0:1786400362.753544:0:8394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.753624:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400362.753635:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392927104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400362.753662:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400362.753684:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400362.753691:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392927232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400362.753710:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400362.753765:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368780928 00000100:00100000:0.0:1786400362.753769:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368780928 00010000:00010000:0.0:1786400362.753798:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 10 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400362.753812:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392927104 00000100:00100000:0.0:1786400362.753821:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392927104 00010000:00010000:0.0:1786400362.753836:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 18 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400362.753847:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392927232 00000100:00100000:0.0:1786400362.753850:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392927232 00010000:00010000:0.0:1786400362.753859:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380030c00/0x49554f35ff0a4eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 19 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400362.753871:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1786400362.753877:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368780928:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400362.753885:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400362.753890:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 10 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.753900:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 10 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.753912:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fda00/0x49554f35ff0a50d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fae expref: 10 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.753922:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400362.753968:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:2362:x1873176368780928:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 91us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400362.753975:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1786400362.753990:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786400362.753996:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392927104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400362.754004:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400362.754008:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 19 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754021:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 19 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754031:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f5a00/0x49554f35ff0a4f50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4f49 expref: 19 pid: 5811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754041:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400362.754068:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:3315:x1873176392927104:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400362.754074:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786400362.754087:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786400362.754093:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3315:x1873176392927232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400362.754101:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400362.754106:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380030c00/0x49554f35ff0a4eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 17 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754115:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380030c00/0x49554f35ff0a4eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 17 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754124:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380030c00/0x49554f35ff0a4eee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a4ee7 expref: 17 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754135:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754142:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754156:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754169:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754175:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754181:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754186:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fd200 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400362.754190:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754197:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754208:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400362.754217:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400362.754239:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3315:x1873176392927232:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400362.754245:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786400362.754270:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392927232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400362.754277:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392927104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400362.754498:0:8394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.754507:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.754514:0:8394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5179 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400362.759245:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1786400362.790393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400362.791016:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368781056 00000100:00100000:2.0:1786400362.791029:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368781056 00000100:00100000:2.0:1786400362.791098:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 172 00000100:00100000:2.0:1786400362.791107:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:5580:x1873176368781056:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400362.791123:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400362.791142:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4fed expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.791170:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.791180:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400362.791190:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fd200, rc 0) 00000100:00100000:2.0:1786400362.791245:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5580:x1873176368781056:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 139us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400362.791260:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 172 00000100:00100000:3.0:1786400362.802348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400362.802394:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368781184 00000100:00100000:3.0:1786400362.802407:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368781184 00000100:00100000:3.0:1786400362.802460:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 173 00000100:00100000:3.0:1786400362.802469:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5580:x1873176368781184:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400362.802794:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5580:x1873176368781184:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 325us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400362.802803:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 173 00000100:00100000:2.0:1786400362.806504:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400362.806619:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368781312 00000100:00100000:3.0:1786400362.806638:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368781312 00000100:00100000:3.0:1786400362.806694:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 174 00000100:00100000:3.0:1786400362.806705:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5580:x1873176368781312:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400362.807174:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:5580:x1873176368781312:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 471us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400362.807183:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 174 00000100:00100000:3.0:1786400362.837563:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400362.837790:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368781440 00000100:00100000:2.0:1786400362.837800:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368781440 00000100:00100000:2.0:1786400362.837868:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 175 00000100:00100000:2.0:1786400362.837878:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:6085:x1873176368781440:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400362.838135:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:6085:x1873176368781440:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 257us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400362.838145:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 175 00000100:00100000:3.0:1786400362.851198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400362.851318:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368781568 00000100:00100000:0.0:1786400362.851329:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368781568 00000100:00100000:0.0:1786400362.851402:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 176 00000100:00100000:0.0:1786400362.851413:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:6085:x1873176368781568:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400362.851647:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:6085:x1873176368781568:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 235us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400362.851656:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 176 00010000:00010000:3.0:1786400363.668074:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786400363.861278:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786400363.861286:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373bf25e800 from 4 10000000:01000000:1.0:1786400363.861292:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786400363.861339:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.861352:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.861363:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400363.861388:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392927360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.861456:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.861510:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0733300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400363.863125:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392927360 00000100:00100000:2.0:1786400363.863137:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392927360 00000100:00100000:2.0:1786400363.863200:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1786400363.863211:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392927360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400363.863227:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400363.863243:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5187 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400363.863281:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400363.863293:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400363.863303:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c21fdc00, rc 0) 00000100:00100000:2.0:1786400363.863365:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392927360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400363.863373:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1786400363.864018:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392927360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400363.864037:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.864048:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400363.864120:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392927488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.864158:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.864203:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0733300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400363.864272:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392927488 00000100:00100000:2.0:1786400363.864278:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392927488 00000100:00100000:2.0:1786400363.864314:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1786400363.864322:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392927488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400363.864574:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392927488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400363.864583:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1786400363.864720:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392927488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.864788:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392927616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.864839:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.864875:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0733300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400363.866443:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392927616 00000100:00100000:2.0:1786400363.866453:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392927616 00000100:00100000:2.0:1786400363.866509:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1786400363.866519:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392927616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400363.866724:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392927616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400363.866731:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786400363.866888:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392927616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.870106:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8435:1873176392927744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400363.870191:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.870243:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0733300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400363.870350:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392927744 00000100:00100000:2.0:1786400363.870358:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392927744 00000100:00100000:2.0:1786400363.870402:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1786400363.870411:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:8435:x1873176392927744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400363.870630:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:8435:x1873176392927744:12345-0@lo:502:llog_process_th.0 Request processed in 219us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400363.870639:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1786400363.870730:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8435:1873176392927744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400363.870804:0:8435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400363.870816:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400363.870818:0:8435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786400363.870841:0:8435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373bf25e800 00000020:00000080:1.0:1786400363.870844:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786400363.871126:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8435:1873176392927872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400363.871165:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.871191:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392927872 00000100:00100000:1.0:1786400363.871194:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392927872 00000100:00100000:1.0:1786400363.871218:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1786400363.871225:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:8435:x1873176392927872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400363.871361:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:8435:x1873176392927872:12345-0@lo:502:llog_process_th.0 Request processed in 135us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400363.871368:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1786400363.871404:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2a600 going to sleep for 11 seconds 00000100:00100000:1.0:1786400363.871423:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8435:1873176392927872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400363.871441:0:8435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400363.871447:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400363.871449:0:8435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786400363.871453:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1786400363.877351:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1786400363.877387:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400363.877401:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400363.877414:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400363.877444:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786400363.877447:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373b7b4b000 from 4 10000000:01000000:2.0:1786400363.877450:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786400363.877488:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400363.877497:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400363.877507:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400363.877533:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786400363.877600:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400363.877649:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e300 going to sleep for 11 seconds 00000100:00100000:1.0:1786400363.878182:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392928000 00000100:00100000:1.0:1786400363.878191:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392928000 00000100:00100000:1.0:1786400363.878247:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1786400363.878265:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392928000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400363.878278:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400363.878293:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5195 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.878317:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.878329:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.878337:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373994f4a00, rc 0) 00000100:00100000:1.0:1786400363.878384:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392928000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400363.878391:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1786400363.878438:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400363.878454:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.878463:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400363.878530:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.878558:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.878581:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2a600 going to sleep for 11 seconds 00000100:00100000:1.0:1786400363.878594:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392928128 00000100:00100000:1.0:1786400363.878597:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392928128 00000100:00100000:1.0:1786400363.878620:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1786400363.878627:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392928128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.879192:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392928128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 563us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400363.879200:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1786400363.889636:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400363.889710:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400363.889990:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400363.890043:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392928256 00000100:00100000:2.0:1786400363.890049:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392928256 00000100:00100000:2.0:1786400363.890097:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786400363.890106:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392928256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400363.890368:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392928256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400363.890376:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786400363.890434:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400363.890457:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400363.903446:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8438:1873176392928384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400363.903527:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400363.903567:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400363.903592:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392928384 00000100:00100000:1.0:1786400363.903600:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392928384 00000100:00100000:1.0:1786400363.903682:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1786400363.903692:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:8438:x1873176392928384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400363.904537:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:8438:x1873176392928384:12345-0@lo:502:llog_process_th.0 Request processed in 843us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400363.904547:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1786400363.907035:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8438:1873176392928384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400363.907080:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400363.907090:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400363.907092:0:8438:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786400363.907100:0:8438:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373b7b4b000 00000020:00000080:1.0:1786400363.907103:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786400363.907187:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8438:1873176392928512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400363.907254:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.909408:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0733300 going to sleep for 11 seconds 00000100:00100000:3.0:1786400363.909474:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392928512 00000100:00100000:3.0:1786400363.909483:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392928512 00000100:00100000:3.0:1786400363.909529:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1786400363.909537:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:8438:x1873176392928512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400363.909803:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:8438:x1873176392928512:12345-0@lo:502:llog_process_th.0 Request processed in 265us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400363.909819:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1786400363.911437:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8438:1873176392928512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400363.911486:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400363.911494:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400363.911496:0:8438:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786400363.911502:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1786400363.911950:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1786400363.911971:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786400363.911981:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.911992:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400363.912003:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786400363.912006:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373910fb800 from 4 10000000:01000000:1.0:1786400363.912008:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786400363.912036:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.912044:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.912054:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400363.912072:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.912119:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.912152:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b07309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400363.912167:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392928640 00000100:00100000:1.0:1786400363.912171:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392928640 00000100:00100000:1.0:1786400363.912204:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1786400363.912212:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392928640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400363.912231:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400363.912243:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a51a3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.913050:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.913063:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.913073:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373994f4c00, rc 0) 00000100:00100000:0.0:1786400363.913301:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392928640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1087us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400363.913309:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1786400363.918226:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400363.918256:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400363.918345:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400363.918428:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400363.918482:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400363.918526:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b07309c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400363.918651:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392928768 00000100:00100000:2.0:1786400363.918657:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392928768 00000100:00100000:2.0:1786400363.918707:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1786400363.918716:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392928768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400363.920548:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392928768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1826us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400363.920561:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1786400363.920561:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400363.920607:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400363.920651:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400363.920688:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84540 going to sleep for 11 seconds 00000100:00100000:2.0:1786400363.922298:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392928896 00000100:00100000:2.0:1786400363.922308:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392928896 00000100:00100000:2.0:1786400363.922354:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786400363.922363:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392928896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400363.922559:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392928896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400363.922567:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786400363.922618:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392928896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400363.933437:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8445:1873176392929024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400363.933725:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400363.933788:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392929024 00000100:00100000:0.0:1786400363.933795:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392929024 00000100:00100000:0.0:1786400363.933905:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1786400363.933914:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:8445:x1873176392929024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400363.934105:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:8445:x1873176392929024:12345-0@lo:502:llog_process_th.0 Request processed in 190us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400363.934118:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1786400363.934228:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400363.934250:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8445:1873176392929024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400363.934277:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400363.934287:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400363.934289:0:8445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786400363.934296:0:8445:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373910fb800 00000020:00000080:0.0:1786400363.934298:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786400363.934373:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8445:1873176392929152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400363.934405:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400363.934422:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400363.934799:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392929152 00000100:00100000:0.0:1786400363.934804:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392929152 00000100:00100000:0.0:1786400363.934912:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1786400363.934920:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:8445:x1873176392929152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400363.935070:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:8445:x1873176392929152:12345-0@lo:502:llog_process_th.0 Request processed in 150us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400363.935077:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1786400363.935117:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:8445:1873176392929152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400363.935139:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400363.935146:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400363.935147:0:8445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1786400363.935151:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1786400363.936344:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1786400363.936372:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400363.936384:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400363.936397:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400364.690951:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400364.838101:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400364.838152:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400364.838182:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400364.838209:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400364.838253:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368781696 00000100:00100000:1.0:1786400364.838265:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368781696 00000100:00100000:1.0:1786400364.838321:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 192 00000100:00100000:3.0:1786400364.838330:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368781824 00000100:00100000:3.0:1786400364.838334:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368781824 00000100:00100000:1.0:1786400364.838340:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368781696:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400364.838380:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:3.0:1786400364.838388:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368781824:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400364.838413:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368781696:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400364.838418:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368781824:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400364.838421:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 192 00000100:00100000:3.0:1786400364.838424:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00080000:3.0:1786400364.838440:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400364.838449:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368781952 00000100:00100000:1.0:1786400364.838452:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368781952 00000100:00100000:1.0:1786400364.838493:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368782080 00000100:00100000:1.0:1786400364.838496:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368782080 00000100:00100000:1.0:1786400364.838513:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:1.0:1786400364.838518:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368781952:12345-192.168.201.23@tcp:400:kworker.0 00000100:00080000:3.0:1786400364.838542:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400364.838544:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368781952:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00080000:3.0:1786400364.838545:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400364.838550:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:1.0:1786400364.838561:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1786400364.838567:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368782080:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400364.838592:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368782080:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400364.838597:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:3.0:1786400365.459133:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392929280:0@lo:400:kworker.0 00000100:00100000:3.0:1786400365.459248:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400365.459457:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392929280 00000100:00100000:0.0:1786400365.459465:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392929280 00000100:00100000:0.0:1786400365.459520:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1786400365.459536:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392929280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400365.466118:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392929280:12345-0@lo:400:kworker.0 Request processed in 6573us (6879us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400365.466135:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1786400365.466223:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392929408:0@lo:400:kworker.0 00000100:00100000:0.0:1786400365.466286:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400365.466531:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392929408 00000100:00100000:1.0:1786400365.466541:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392929408 00000100:00100000:1.0:1786400365.466591:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786400365.466600:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392929408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400365.466652:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392929408:12345-0@lo:400:kworker.0 Request processed in 54us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400365.466658:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786400365.473691:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392929536:0@lo:400:kworker.0 00000100:00100000:1.0:1786400365.473798:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400365.473837:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400365.473858:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392929664:0@lo:400:kworker.0 00000100:00100000:1.0:1786400365.473886:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400365.473920:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392929664 00000100:00100000:1.0:1786400365.473928:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392929664 00000100:00100000:1.0:1786400365.474002:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786400365.474013:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400365.474067:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392929664:12345-0@lo:400:kworker.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400365.474074:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1786400365.474093:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786400365.474123:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884e300 x1873176392929664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400365.474137:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392929664:0@lo:400:kworker.0 00000100:00100000:0.0:1786400365.475512:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392929536 00000100:00100000:0.0:1786400365.475522:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392929536 00000100:00100000:0.0:1786400365.475595:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786400365.475605:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392929536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400365.475670:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392929536:12345-0@lo:400:kworker.0 Request processed in 68us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400365.475676:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786400365.475709:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392929920:0@lo:400:kworker.0 00000100:00100000:0.0:1786400365.475777:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400365.475814:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392929408:0@lo:400:kworker.0 00000100:00100000:0.0:1786400365.475831:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400365.475836:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392929792:0@lo:400:kworker.0 00000100:00100000:0.0:1786400365.475870:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400365.475910:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392929792 00000100:00100000:0.0:1786400365.475914:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392929792 00000100:00100000:0.0:1786400365.475953:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786400365.475959:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392929792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400365.475991:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392929792:12345-0@lo:400:kworker.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400365.476014:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786400365.476041:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392929792:0@lo:400:kworker.0 00000100:00100000:1.0:1786400365.478354:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392929920 00000100:00100000:1.0:1786400365.478371:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392929920 00000100:00100000:1.0:1786400365.478462:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786400365.478472:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392929920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400365.478570:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392929920:12345-0@lo:400:kworker.0 Request processed in 99us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400365.478577:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1786400365.478601:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400365.478606:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400365.478645:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392929536:0@lo:400:kworker.0 00010000:00080000:2.0:1786400365.478857:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884dc00 x1873176392929920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400365.478882:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392929920:0@lo:400:kworker.0 00000100:00100000:3.0:1786400365.486288:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392929280:0@lo:400:kworker.0 00010000:00010000:3.0:1786400365.715181:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400365.971550:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392930048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400365.971631:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400365.971828:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392930048 00000100:00100000:2.0:1786400365.971837:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392930048 00000100:00100000:2.0:1786400365.971892:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786400365.971902:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392930048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400365.971946:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400365.971996:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392930048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400365.972004:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1786400365.972240:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884dc00 x1873176392930048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400365.972259:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392930048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786400366.744787:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400366.996935:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392930176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400366.997015:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400366.997227:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392930176 00000100:00100000:1.0:1786400366.997235:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392930176 00000100:00100000:1.0:1786400366.997291:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786400366.997302:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392930176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400366.997337:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400367.001508:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392930176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4197us (4482us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400367.001525:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1786400367.003786:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c65500 x1873176392930176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400367.003820:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392930176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786400367.767226:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400368.795208:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400369.543341:0:8695:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1786400369.812735:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400369.952377:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400369.952414:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400369.952444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400369.952493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400369.952528:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368782336 00000100:00100000:3.0:1786400369.952538:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368782336 00000100:00100000:3.0:1786400369.952603:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:3.0:1786400369.952612:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368782336:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400369.952687:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368782336:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400369.952696:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:1.0:1786400369.955325:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368782208 00000100:00100000:1.0:1786400369.955355:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368782208 00000100:00100000:1.0:1786400369.955415:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 194 00000100:00100000:1.0:1786400369.955424:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2359:x1873176368782208:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400369.955492:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2359:x1873176368782208:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 70us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400369.955500:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 194 00000100:00100000:1.0:1786400369.955533:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368782464 00000100:00100000:1.0:1786400369.955537:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368782464 00000100:00100000:1.0:1786400369.955566:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368782592 00000100:00100000:1.0:1786400369.955568:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368782592 00000100:00100000:1.0:1786400369.955584:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1786400369.955590:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368782464:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400369.955617:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368782464:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (3205us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400369.955636:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1786400369.955660:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:1.0:1786400369.955666:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368782592:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400369.955693:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368782592:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400369.955702:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00080000:1.0:1786400369.955724:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400369.955728:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400369.955730:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400370.579431:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392930560:0@lo:400:kworker.0 00000100:00100000:3.0:1786400370.579504:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400370.579557:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400370.579564:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392930688:0@lo:400:kworker.0 00000100:00100000:3.0:1786400370.579588:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400370.579675:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392930304:0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.579720:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400370.579780:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392930816:0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.579803:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400370.579822:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786400370.579828:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392930432:0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.579849:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400370.579866:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392930944:0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.579886:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400370.579915:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392930560 00000100:00100000:2.0:1786400370.579921:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392930560 00000100:00100000:2.0:1786400370.579972:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392930816 00000100:00100000:2.0:1786400370.579976:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392930816 00000100:00100000:2.0:1786400370.579992:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392930432 00000100:00100000:2.0:1786400370.580000:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392930432 00000100:00100000:2.0:1786400370.580017:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786400370.580026:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392930560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.580078:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392930560:12345-0@lo:400:kworker.0 Request processed in 53us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400370.580085:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786400370.580101:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786400370.580107:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392930816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.580138:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392930816:12345-0@lo:400:kworker.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400370.580155:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786400370.580167:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786400370.580173:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392930432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.580201:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392930432:12345-0@lo:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400370.580207:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786400370.580229:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392930688 00000100:00100000:2.0:1786400370.580233:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392930688 00000100:00100000:2.0:1786400370.580257:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392930944 00000100:00100000:2.0:1786400370.580259:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392930944 00000100:00100000:2.0:1786400370.580272:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786400370.580278:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392930688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.580307:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392930688:12345-0@lo:400:kworker.0 Request processed in 28us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400370.580313:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786400370.580323:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786400370.580329:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392930944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.580365:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392930944:12345-0@lo:400:kworker.0 Request processed in 36us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400370.580371:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1786400370.580387:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400370.580390:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786400370.580393:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786400370.580421:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391174000 x1873176392930688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400370.580434:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392930688:0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.580443:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392930560:0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.580469:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392930432:0@lo:400:kworker.0 00010000:00080000:2.0:1786400370.580478:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391174a80 x1873176392930944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400370.580486:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392930944:0@lo:400:kworker.0 00000100:00100000:2.0:1786400370.580493:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392930816:0@lo:400:kworker.0 00000100:00100000:3.0:1786400370.581833:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392930304 00000100:00100000:3.0:1786400370.581845:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392930304 00000100:00100000:3.0:1786400370.581895:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1786400370.581904:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392930304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400370.581968:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392930304:12345-0@lo:400:kworker.0 Request processed in 67us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400370.581975:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1786400370.582127:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392930304:0@lo:400:kworker.0 00010000:00010000:0.0:1786400370.856828:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400371.092079:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400371.092106:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392931072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400371.092174:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400371.096796:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392931072 00000100:00100000:0.0:1786400371.096811:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392931072 00000100:00100000:0.0:1786400371.096895:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786400371.096906:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392931072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400371.096946:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400371.097037:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392931072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400371.097045:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1786400371.097282:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884c000 x1873176392931072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400371.097303:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392931072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400371.859547:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400372.115987:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392931200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400372.116065:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400372.116461:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392931200 00000100:00100000:1.0:1786400372.116470:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392931200 00000100:00100000:1.0:1786400372.116532:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786400372.116541:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392931200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400372.116573:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400372.116640:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392931200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (574us total) trans 0 rc 0/0 00000100:00080000:2.0:1786400372.116643:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400372.116647:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1786400372.116813:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391174700 x1873176392931200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400372.116832:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392931200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786400372.882926:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400373.906902:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400374.930950:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400375.074488:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400375.074595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400375.074704:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368782848 00000100:00100000:0.0:1786400375.074715:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368782848 00000100:00100000:0.0:1786400375.074809:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:0.0:1786400375.074819:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368782848:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400375.074891:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368782848:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 74us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400375.074898:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00080000:1.0:1786400375.075274:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400375.075516:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368782720 00000100:00100000:3.0:1786400375.075522:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368782720 00000100:00100000:3.0:1786400375.075577:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 196 00000100:00100000:3.0:1786400375.075584:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368782720:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400375.075626:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368782720:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 42us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400375.075633:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 196 00000100:00100000:3.0:1786400375.086966:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400375.087060:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400375.087106:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368782976 00000100:00100000:3.0:1786400375.087118:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368782976 00000100:00100000:3.0:1786400375.087186:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368783104 00000100:00100000:3.0:1786400375.087189:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368783104 00000100:00100000:3.0:1786400375.087207:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1786400375.087216:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2358:x1873176368782976:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:3.0:1786400375.087263:0:6624:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a50e6 00000100:00080000:3.0:1786400375.087275:0:6624:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786400375.087321:0:6624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786400375.087799:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+2:2358:x1873176368782976:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 582us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400375.087825:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1786400375.087845:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:3.0:1786400375.087852:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2358:x1873176368783104:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:3.0:1786400375.087869:0:6624:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a50ed 00000100:00080000:3.0:1786400375.087876:0:6624:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786400375.087905:0:6624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786400375.088099:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+2:2358:x1873176368783104:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 246us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400375.088108:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00080000:3.0:1786400375.088132:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400375.088136:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786400375.088204:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400375.088212:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400375.630972:0:8939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing yml_node 00000100:00100000:0.0:1786400375.700311:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392931456:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.700419:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400375.700481:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392931968:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.700508:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400375.700546:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786400375.700564:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392931328:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.700595:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400375.700618:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392931840:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.700639:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400375.700667:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392931584:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.700691:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400375.700711:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400375.700716:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392931712:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.700773:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400375.700813:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392931456 00000100:00100000:0.0:1786400375.700825:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392931456 00000100:00100000:0.0:1786400375.701113:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392931840 00000100:00100000:0.0:1786400375.701119:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392931840 00000100:00100000:0.0:1786400375.701194:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392931584 00000100:00100000:0.0:1786400375.701198:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392931584 00000100:00080000:3.0:1786400375.703823:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400375.705103:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786400375.705120:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392931456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.705267:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392931456:12345-0@lo:400:kworker.0 Request processed in 151us (4847us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400375.705276:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786400375.705298:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786400375.705307:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392931840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.705356:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392931840:12345-0@lo:400:kworker.0 Request processed in 52us (4716us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400375.705362:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786400375.705375:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786400375.705382:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392931584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.705417:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392931584:12345-0@lo:400:kworker.0 Request processed in 35us (4724us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400375.705423:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786400375.705454:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392931968 00000100:00100000:0.0:1786400375.705463:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392931968 00000100:00100000:0.0:1786400375.705501:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392931712 00000100:00100000:0.0:1786400375.705504:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392931712 00000100:00100000:0.0:1786400375.705519:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786400375.705525:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392931968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.705572:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392931968:12345-0@lo:400:kworker.0 Request processed in 47us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400375.705579:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786400375.705590:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786400375.705596:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392931712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.705636:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392931712:12345-0@lo:400:kworker.0 Request processed in 41us (4896us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400375.705642:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786400375.705662:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392931328 00000100:00100000:0.0:1786400375.705666:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392931328 00000100:00100000:0.0:1786400375.705693:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1786400375.705700:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392931328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.705766:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392931328:12345-0@lo:400:kworker.0 Request processed in 66us (5169us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400375.705774:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1786400375.705859:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392931328:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.705878:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392931840:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.706035:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392931456:0@lo:400:kworker.0 00010000:00080000:0.0:1786400375.706050:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c65500 x1873176392931968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400375.706062:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392931968:0@lo:400:kworker.0 00010000:00080000:0.0:1786400375.706114:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c64380 x1873176392931712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400375.706125:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392931712:0@lo:400:kworker.0 00000100:00100000:0.0:1786400375.706138:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392931584:0@lo:400:kworker.0 00000100:00080000:2.0:1786400375.708299:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786400375.708309:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786400375.959447:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400376.214230:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392932096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400376.214343:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400376.214934:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392932096 00000100:00100000:2.0:1786400376.214947:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392932096 00000100:00100000:2.0:1786400376.215014:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786400376.215025:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392932096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400376.215085:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400376.215152:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392932096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400376.215160:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1786400376.216235:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884ca80 x1873176392932096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400376.216265:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392932096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786400376.979092:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400377.241378:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392932224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400377.241487:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400377.241629:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392932224 00000100:00100000:1.0:1786400377.241640:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392932224 00000100:00100000:1.0:1786400377.241758:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786400377.241770:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392932224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400377.241819:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400377.248945:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392932224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7161us (7442us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400377.248965:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1786400377.249033:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786400377.252472:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884d880 x1873176392932224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400377.252512:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392932224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400378.003174:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786400378.310230:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:1.0:1786400378.310243:0:6647:0:(genops.c:906:class_export_put()) final put ffff9373b9c59000/2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:0.0:1786400378.310331:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b9c59000/2e546c9b-fa03-4565-a5c8-6992a70a28db for lustre-OST0000 00000020:00000080:0.0:1786400378.310389:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373bf7d4000 for lustre-OST0000 00010000:00010000:3.0:1786400379.034046:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786400379.334888:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:0.0:1786400379.334898:0:7536:0:(genops.c:906:class_export_put()) final put ffff9373bf7d6800/2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:2.0:1786400379.334971:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf7d6800/2e546c9b-fa03-4565-a5c8-6992a70a28db for lustre-OST0001 00000020:00000080:2.0:1786400379.335030:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373bf7d3800 for lustre-OST0001 00010000:00010000:0.0:1786400380.052594:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400380.194840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400380.194877:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368783232 00000100:00100000:0.0:1786400380.194888:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368783232 00000100:00100000:3.0:1786400380.194891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400380.194953:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 198 00000100:00100000:0.0:1786400380.194964:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368783232:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400380.195040:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368783232:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400380.195047:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 198 00000100:00100000:0.0:1786400380.195081:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368783360 00000100:00100000:0.0:1786400380.195085:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368783360 00000100:00100000:0.0:1786400380.195132:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:0.0:1786400380.195139:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368783360:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400380.195170:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368783360:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 32us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400380.195177:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00080000:3.0:1786400380.200071:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1786400380.347570:0:9131:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.107 00000100:00100000:1.0:1786400380.819083:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392932608:0@lo:400:kworker.0 00000100:00100000:1.0:1786400380.819162:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400380.819237:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400380.819244:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392932736:0@lo:400:kworker.0 00000100:00100000:1.0:1786400380.819270:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400380.819675:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392932352:0@lo:400:kworker.0 00000100:00100000:2.0:1786400380.819716:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400380.819806:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392932864:0@lo:400:kworker.0 00000100:00100000:2.0:1786400380.819832:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400380.819851:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786400380.819857:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392932480:0@lo:400:kworker.0 00000100:00100000:2.0:1786400380.819877:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400380.819891:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392932992:0@lo:400:kworker.0 00000100:00100000:2.0:1786400380.819911:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400380.820254:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392932608 00000100:00100000:0.0:1786400380.820263:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392932608 00000100:00100000:0.0:1786400380.820320:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392932864 00000100:00100000:0.0:1786400380.820324:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392932864 00000100:00100000:0.0:1786400380.820338:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392932480 00000100:00100000:0.0:1786400380.820341:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392932480 00000100:00100000:0.0:1786400380.820357:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786400380.820367:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392932608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400380.820735:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392932352 00000100:00100000:3.0:1786400380.820766:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392932352 00000100:00100000:3.0:1786400380.820797:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1786400380.820804:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392932352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400380.820862:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392932352:12345-0@lo:400:kworker.0 Request processed in 58us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400380.820869:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1786400380.820921:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392932352:0@lo:400:kworker.0 00000100:00100000:0.0:1786400380.821090:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392932608:12345-0@lo:400:kworker.0 Request processed in 725us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400380.821106:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786400380.821123:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786400380.821129:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392932864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400380.821167:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392932864:12345-0@lo:400:kworker.0 Request processed in 39us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400380.821172:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1786400380.821505:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400380.822321:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786400380.822337:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392932480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400380.822643:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392932480:12345-0@lo:400:kworker.0 Request processed in 310us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400380.822651:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786400380.822681:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392932736 00000100:00100000:0.0:1786400380.822687:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392932736 00000100:00100000:0.0:1786400380.822760:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392932992 00000100:00100000:0.0:1786400380.822764:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392932992 00000100:00100000:0.0:1786400380.822783:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786400380.822789:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392932736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400380.822824:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392932736:12345-0@lo:400:kworker.0 Request processed in 34us (3552us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400380.822831:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786400380.822843:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786400380.822849:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392932992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400380.822879:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392932992:12345-0@lo:400:kworker.0 Request processed in 29us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400380.822884:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1786400380.822953:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391176300 x1873176392932736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400380.822982:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392932736:0@lo:400:kworker.0 00000100:00100000:0.0:1786400380.822997:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392932608:0@lo:400:kworker.0 00000100:00100000:3.0:1786400380.823097:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392932480:0@lo:400:kworker.0 00010000:00080000:3.0:1786400380.823108:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391175c00 x1873176392932992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400380.823116:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392932992:0@lo:400:kworker.0 00000100:00100000:3.0:1786400380.823126:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392932864:0@lo:400:kworker.0 00000100:00080000:1.0:1786400380.825257:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400380.825268:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786400381.075893:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400381.332879:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392933120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400381.332950:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400381.333499:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392933120 00000100:00100000:2.0:1786400381.333574:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392933120 00000100:00100000:2.0:1786400381.333636:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786400381.333646:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392933120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400381.333683:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400381.333733:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392933120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400381.333764:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1786400381.337990:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b79c9f80 x1873176392933120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400381.338018:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392933120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400382.099954:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400382.357365:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400382.357392:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392933248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400382.357500:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400382.357726:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392933248 00000100:00100000:2.0:1786400382.357734:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392933248 00000100:00100000:2.0:1786400382.357827:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786400382.357838:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392933248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400382.357881:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400382.357932:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392933248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400382.357940:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1786400382.358290:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786400382.358324:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884d500 x1873176392933248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400382.358345:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392933248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400383.124657:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400383.464654:0:9228:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.107 00010000:00010000:1.0:1786400384.152055:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400385.170952:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400385.314866:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400385.314974:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400385.315284:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368783488 00000100:00100000:1.0:1786400385.315293:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368783488 00000100:00100000:1.0:1786400385.315345:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 200 00000100:00100000:1.0:1786400385.315353:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2359:x1873176368783488:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400385.315430:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2359:x1873176368783488:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 78us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400385.315448:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 200 00000100:00100000:2.0:1786400385.316131:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368783616 00000100:00100000:2.0:1786400385.316137:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368783616 00000100:00100000:2.0:1786400385.316190:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:2.0:1786400385.316198:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368783616:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400385.316235:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368783616:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 38us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400385.316242:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00080000:1.0:1786400385.316883:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400385.938956:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392933504:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939027:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400385.939075:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392934016:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939101:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400385.939132:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786400385.939138:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392933376:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939164:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400385.939184:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392933888:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939202:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400385.939242:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392933632:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939264:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400385.939282:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400385.939287:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392933760:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939308:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400385.939348:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392933504 00000100:00100000:3.0:1786400385.939355:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392933504 00000100:00100000:3.0:1786400385.939404:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392933888 00000100:00100000:3.0:1786400385.939408:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392933888 00000100:00100000:3.0:1786400385.939431:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392933632 00000100:00100000:3.0:1786400385.939433:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392933632 00000100:00100000:3.0:1786400385.939449:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786400385.939456:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392933504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939505:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392933504:12345-0@lo:400:kworker.0 Request processed in 48us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400385.939512:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786400385.939528:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786400385.939534:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392933888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939561:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392933888:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400385.939567:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786400385.939577:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786400385.939582:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392933632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939611:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392933632:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400385.939619:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786400385.939639:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392934016 00000100:00100000:3.0:1786400385.939643:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392934016 00000100:00100000:3.0:1786400385.939666:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392933760 00000100:00100000:3.0:1786400385.939669:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392933760 00000100:00100000:3.0:1786400385.939683:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786400385.939689:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392934016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939717:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392934016:12345-0@lo:400:kworker.0 Request processed in 28us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400385.939730:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786400385.939766:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786400385.939773:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392933760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939802:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392933760:12345-0@lo:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400385.939808:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786400385.939829:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392933376 00000100:00100000:3.0:1786400385.939832:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392933376 00000100:00100000:3.0:1786400385.939855:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1786400385.939861:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392933376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939888:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392933376:12345-0@lo:400:kworker.0 Request processed in 27us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400385.939894:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1786400385.939929:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786400385.939933:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400385.939936:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786400385.939964:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391177800 x1873176392933760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400385.939977:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392933760:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.939987:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392933632:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.940014:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392933376:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.940023:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392933888:0@lo:400:kworker.0 00000100:00100000:3.0:1786400385.940032:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392933504:0@lo:400:kworker.0 00010000:00080000:3.0:1786400385.940051:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391174700 x1873176392934016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400385.940060:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392934016:0@lo:400:kworker.0 00010000:00010000:1.0:1786400386.195153:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400386.457973:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392934144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400386.458063:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400386.458151:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392934144 00000100:00100000:3.0:1786400386.458160:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392934144 00000100:00100000:3.0:1786400386.458210:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786400386.458220:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392934144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400386.458258:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400386.458301:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392934144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400386.458309:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1786400386.458358:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282437100 x1873176392934144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400386.458390:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392934144:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1786400386.470127:0:9327:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.107 00010000:00010000:3.0:1786400387.218904:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400387.475039:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392934272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400387.475117:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400387.475233:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392934272 00000100:00100000:0.0:1786400387.475242:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392934272 00000100:00100000:0.0:1786400387.475306:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786400387.475316:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392934272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400387.475366:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1786400387.475442:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400387.476901:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392934272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1580us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400387.476914:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1786400387.477022:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884f480 x1873176392934272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400387.477049:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392934272:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1786400388.145233:0:9375:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 10 18:19:46 EDT 2026 00010000:00010000:1.0:1786400388.250401:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400389.267124:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400390.295282:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400390.432376:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400390.432681:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368783744 00000100:00100000:3.0:1786400390.432693:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368783744 00000100:00100000:3.0:1786400390.432787:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 202 00000100:00100000:3.0:1786400390.432799:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368783744:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400390.432875:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368783744:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 78us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400390.432884:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 202 00000100:00100000:3.0:1786400390.432987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400390.433066:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368783872 00000100:00100000:3.0:1786400390.433071:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368783872 00000100:00100000:3.0:1786400390.433111:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:3.0:1786400390.433119:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368783872:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400390.433407:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368783872:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 288us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400390.433415:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00080000:1.0:1786400390.434459:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400391.062013:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400391.062037:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392934656:0@lo:400:kworker.0 00000100:00100000:3.0:1786400391.062108:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400391.062242:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392934784:0@lo:400:kworker.0 00000100:00100000:3.0:1786400391.062276:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400391.062326:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392934784 00000100:00100000:3.0:1786400391.062332:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392934784 00000100:00100000:3.0:1786400391.062383:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786400391.062391:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392934784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400391.062446:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392934784:12345-0@lo:400:kworker.0 Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400391.062460:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1786400391.062501:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe41c00 x1873176392934784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400391.062517:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392934784:0@lo:400:kworker.0 00000100:00100000:0.0:1786400391.062604:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392934400:0@lo:400:kworker.0 00000100:00100000:0.0:1786400391.062641:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400391.062674:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392934912:0@lo:400:kworker.0 00000100:00100000:0.0:1786400391.062698:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400391.062725:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786400391.062732:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392934528:0@lo:400:kworker.0 00000100:00100000:0.0:1786400391.062796:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400391.062811:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392935040:0@lo:400:kworker.0 00000100:00100000:0.0:1786400391.062831:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786400391.062987:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400391.063419:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392934400 00000100:00100000:3.0:1786400391.063424:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392934400 00000100:00100000:3.0:1786400391.063462:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1786400391.063469:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392934400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400391.063518:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392934400:12345-0@lo:400:kworker.0 Request processed in 49us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400391.063524:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1786400391.063553:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392934656 00000100:00100000:3.0:1786400391.063556:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392934656 00000100:00100000:3.0:1786400391.063598:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392934912 00000100:00100000:3.0:1786400391.063602:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392934912 00000100:00100000:3.0:1786400391.063614:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392934528 00000100:00100000:3.0:1786400391.063616:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392934528 00000100:00100000:3.0:1786400391.063628:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786400391.063634:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392934656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400391.063668:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392934656:12345-0@lo:400:kworker.0 Request processed in 34us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400391.063674:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786400391.063686:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786400391.063692:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392934912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400391.063718:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392934912:12345-0@lo:400:kworker.0 Request processed in 26us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400391.063736:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786400391.063787:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786400391.063793:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392934528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400391.063819:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392934528:12345-0@lo:400:kworker.0 Request processed in 27us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400391.063825:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786400391.063845:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392935040 00000100:00100000:3.0:1786400391.063848:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392935040 00000100:00100000:3.0:1786400391.063871:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786400391.063877:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392935040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400391.063907:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392935040:12345-0@lo:400:kworker.0 Request processed in 29us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400391.063913:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786400391.063947:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392934656:0@lo:400:kworker.0 00000100:00080000:1.0:1786400391.064062:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400391.064067:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400391.064087:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392934528:0@lo:400:kworker.0 00010000:00080000:1.0:1786400391.064099:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe42d80 x1873176392935040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400391.064109:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392935040:0@lo:400:kworker.0 00000100:00100000:1.0:1786400391.064117:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392934400:0@lo:400:kworker.0 00000100:00100000:1.0:1786400391.064125:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392934912:0@lo:400:kworker.0 00010000:00010000:2.0:1786400391.322489:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400391.572656:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400391.572680:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392935168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400391.572777:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400391.573255:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392935168 00000100:00100000:1.0:1786400391.573264:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392935168 00000100:00100000:1.0:1786400391.573330:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786400391.573339:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392935168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400391.573386:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400391.573447:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392935168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400391.573454:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1786400391.573844:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282434700 x1873176392935168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400391.573862:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392935168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400392.342663:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400392.595215:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392935296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400392.595332:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400392.595609:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392935296 00000100:00100000:3.0:1786400392.595616:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392935296 00000100:00100000:3.0:1786400392.595679:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786400392.595688:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392935296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400392.595756:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400392.595808:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392935296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400392.595815:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1786400392.596000:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe40000 x1873176392935296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400392.596018:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392935296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400393.362956:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400394.390294:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400395.412055:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400395.553558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400395.556891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400395.557165:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368784128 00000100:00100000:3.0:1786400395.557175:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368784128 00000100:00100000:3.0:1786400395.557278:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:3.0:1786400395.557288:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368784128:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400395.557398:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368784128:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 111us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400395.557407:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00080000:2.0:1786400395.557629:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400395.559413:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368784000 00000100:00100000:1.0:1786400395.559424:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368784000 00000100:00100000:1.0:1786400395.559533:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 204 00000100:00100000:1.0:1786400395.559543:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368784000:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400395.559619:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368784000:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 78us (6071us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400395.559627:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 204 00000100:00100000:3.0:1786400396.179138:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392935552:0@lo:400:kworker.0 00000100:00100000:3.0:1786400396.179226:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400396.179407:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392936064:0@lo:400:kworker.0 00000100:00100000:3.0:1786400396.179436:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400396.179468:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786400396.179474:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392935424:0@lo:400:kworker.0 00000100:00100000:3.0:1786400396.179502:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400396.179688:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392935680:0@lo:400:kworker.0 00000100:00100000:2.0:1786400396.179735:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400396.179787:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392935552 00000100:00100000:2.0:1786400396.179795:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392935552 00000100:00100000:2.0:1786400396.179843:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392935680 00000100:00100000:2.0:1786400396.179846:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392935680 00000100:00100000:2.0:1786400396.179874:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1786400396.179882:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392935552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400396.180442:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392935936:0@lo:400:kworker.0 00000100:00100000:3.0:1786400396.180475:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400396.180504:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392935808:0@lo:400:kworker.0 00000100:00100000:0.0:1786400396.181449:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392935424 00000100:00100000:0.0:1786400396.181457:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392935424 00000100:00100000:0.0:1786400396.181507:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1786400396.181516:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392935424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400396.184323:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392935936 00000100:00100000:1.0:1786400396.184337:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392935936 00000100:00100000:1.0:1786400396.184384:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786400396.184395:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392935680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400396.188362:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392935552:12345-0@lo:400:kworker.0 Request processed in 8470us (9127us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400396.188379:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1786400396.188433:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786400396.188446:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392935936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400396.188500:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392935936:12345-0@lo:400:kworker.0 Request processed in 59us (8023us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400396.188506:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1786400396.188694:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400396.188845:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392936064 00000100:00100000:2.0:1786400396.188854:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392936064 00000100:00100000:2.0:1786400396.188897:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786400396.188904:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392936064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400396.188954:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392936064:12345-0@lo:400:kworker.0 Request processed in 51us (9517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400396.188960:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1786400396.188980:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400396.189695:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400396.189772:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392935808 00000100:00100000:3.0:1786400396.189777:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392935808 00000100:00100000:3.0:1786400396.189826:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786400396.189833:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392935808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400396.189874:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392935808:12345-0@lo:400:kworker.0 Request processed in 43us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400396.189880:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1786400396.189904:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786400396.190053:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe43100 x1873176392935808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400396.190065:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392935808:0@lo:400:kworker.0 00000100:00100000:3.0:1786400396.190094:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392935936:0@lo:400:kworker.0 00000100:00100000:3.0:1786400396.190104:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392935552:0@lo:400:kworker.0 00010000:00080000:3.0:1786400396.190116:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe42a00 x1873176392936064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400396.190124:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392936064:0@lo:400:kworker.0 00000100:00100000:0.0:1786400396.190241:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392935424:12345-0@lo:400:kworker.0 Request processed in 8725us (10736us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400396.190330:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392935424:0@lo:400:kworker.0 00000100:00100000:0.0:1786400396.190367:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1786400396.191393:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392935680:12345-0@lo:400:kworker.0 Request processed in 6988us (11644us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400396.191406:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786400396.201110:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392935680:0@lo:400:kworker.0 00010000:00010000:2.0:1786400396.435209:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400396.695791:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400396.695828:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392936192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400396.695892:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400396.695957:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392936192 00000100:00100000:1.0:1786400396.695965:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392936192 00000100:00100000:1.0:1786400396.696011:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786400396.696020:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392936192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400396.696053:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400396.696092:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392936192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400396.696099:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1786400396.696140:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282437480 x1873176392936192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400396.696157:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392936192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400397.459960:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400397.721153:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400397.721185:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392936320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400397.722086:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400397.723575:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392936320 00000100:00100000:2.0:1786400397.723597:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392936320 00000100:00100000:2.0:1786400397.723654:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786400397.723664:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392936320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400397.723712:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400397.723787:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392936320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400397.723793:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1786400397.725008:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe40e00 x1873176392936320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400397.725030:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392936320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400398.482950:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400399.507891:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400400.534782:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400400.676556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400400.676594:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400400.676630:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368784256 00000100:00100000:3.0:1786400400.676640:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368784256 00000100:00100000:3.0:1786400400.676687:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 206 00000100:00100000:3.0:1786400400.676696:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2359:x1873176368784256:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400400.676782:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2359:x1873176368784256:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400400.676791:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 206 00000100:00100000:3.0:1786400400.676823:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368784384 00000100:00100000:3.0:1786400400.676827:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368784384 00000100:00100000:3.0:1786400400.676864:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:3.0:1786400400.676872:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368784384:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400400.676902:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368784384:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 31us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400400.676909:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00080000:3.0:1786400400.677025:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400401.312507:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400401.317590:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392936576:0@lo:400:kworker.0 00000100:00100000:0.0:1786400401.317672:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400401.317753:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392936448:0@lo:400:kworker.0 00000100:00100000:0.0:1786400401.317785:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400401.317844:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392936576 00000100:00100000:0.0:1786400401.317852:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392936576 00000100:00100000:0.0:1786400401.317901:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786400401.317910:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392936576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400401.317967:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392936576:12345-0@lo:400:kworker.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400401.317975:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786400401.317999:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392936448 00000100:00100000:0.0:1786400401.318002:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392936448 00000100:00100000:0.0:1786400401.318029:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1786400401.318035:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392936448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400401.318064:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392936448:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400401.318070:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1786400401.318132:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392936576:0@lo:400:kworker.0 00000100:00100000:0.0:1786400401.318145:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392936448:0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.335334:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400401.335361:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392936704:0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.335440:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400401.335488:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392936704 00000100:00100000:2.0:1786400401.335495:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392936704 00000100:00100000:2.0:1786400401.335563:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786400401.335572:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392936704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.335621:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392936704:12345-0@lo:400:kworker.0 Request processed in 51us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400401.335628:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1786400401.335649:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400401.335680:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392936704:0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.335713:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392936832:0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.335768:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400401.335797:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392936832 00000100:00100000:2.0:1786400401.335802:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392936832 00000100:00100000:2.0:1786400401.335834:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786400401.335841:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392936832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.335875:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392936832:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400401.335892:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1786400401.335904:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400401.335924:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884d180 x1873176392936832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400401.335935:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392936832:0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.335964:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392936960:0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.335986:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400401.336012:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392936960 00000100:00100000:2.0:1786400401.336016:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392936960 00000100:00100000:2.0:1786400401.336044:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786400401.336051:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392936960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.336085:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392936960:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400401.336091:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1786400401.336117:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400401.336137:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392936960:0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.336164:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400401.336171:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392937088:0@lo:400:kworker.0 00000100:00100000:2.0:1786400401.336193:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400401.336796:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392937088 00000100:00100000:3.0:1786400401.336801:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392937088 00000100:00100000:3.0:1786400401.336838:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786400401.336845:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392937088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400401.336886:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392937088:12345-0@lo:400:kworker.0 Request processed in 43us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400401.336892:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1786400401.336917:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b884d180 x1873176392937088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400401.336927:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392937088:0@lo:400:kworker.0 00000100:00080000:2.0:1786400401.344640:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786400401.560645:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400401.811072:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392937216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400401.811393:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400401.811533:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392937216 00000100:00100000:2.0:1786400401.811542:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392937216 00000100:00100000:2.0:1786400401.811655:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786400401.811666:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392937216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400401.811711:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400401.812459:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392937216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 793us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400401.812470:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1786400401.813010:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282437480 x1873176392937216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400401.813032:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392937216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400402.579025:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400402.835010:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400402.835037:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392937344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400402.835132:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400402.835823:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392937344 00000100:00100000:3.0:1786400402.835832:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392937344 00000100:00100000:3.0:1786400402.835925:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786400402.835935:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392937344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400402.835972:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400402.836032:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392937344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400402.836040:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1786400402.836245:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe43800 x1873176392937344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400402.836285:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392937344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400403.604360:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400404.627463:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400405.654211:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400405.796801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400405.796860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400405.796894:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368784640 00000100:00100000:3.0:1786400405.796904:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368784640 00000100:00100000:3.0:1786400405.796975:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:3.0:1786400405.796985:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368784640:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400405.797092:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368784640:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400405.797101:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00080000:3.0:1786400405.797230:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400405.797563:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368784512 00000100:00100000:1.0:1786400405.797569:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368784512 00000100:00100000:1.0:1786400405.797613:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 208 00000100:00100000:1.0:1786400405.797621:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368784512:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400405.797658:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368784512:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 39us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400405.797665:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 208 00000100:00100000:1.0:1786400406.422530:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392937728:0@lo:400:kworker.0 00000100:00100000:1.0:1786400406.422601:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400406.422658:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400406.422665:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392937856:0@lo:400:kworker.0 00000100:00100000:1.0:1786400406.422690:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400406.422734:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392937728 00000100:00100000:1.0:1786400406.422764:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392937728 00000100:00100000:1.0:1786400406.422817:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786400406.422826:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392937728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400406.422875:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392937728:12345-0@lo:400:kworker.0 Request processed in 50us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400406.422883:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786400406.422907:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392937856 00000100:00100000:1.0:1786400406.422910:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392937856 00000100:00100000:1.0:1786400406.422936:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786400406.422942:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392937856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400406.422973:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392937856:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400406.422980:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1786400406.422995:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400406.423000:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786400406.423053:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282436300 x1873176392937856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400406.423068:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392937856:0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.423392:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392937600:0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.423426:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400406.423448:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392938112:0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.423470:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400406.423496:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786400406.423515:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392937472:0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.423544:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400406.423566:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392937984:0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.423722:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400406.423770:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392937600 00000100:00100000:0.0:1786400406.423774:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392937600 00000100:00100000:0.0:1786400406.423808:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392937984 00000100:00100000:0.0:1786400406.423811:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392937984 00000100:00100000:0.0:1786400406.423838:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786400406.423846:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392937600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.423890:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392937600:12345-0@lo:400:kworker.0 Request processed in 45us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400406.423898:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786400406.423910:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786400406.423916:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392937984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.423945:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392937984:12345-0@lo:400:kworker.0 Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400406.423951:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786400406.423969:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392938112 00000100:00100000:0.0:1786400406.423973:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392938112 00000100:00100000:0.0:1786400406.423997:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786400406.424011:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392938112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.424061:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392938112:12345-0@lo:400:kworker.0 Request processed in 51us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400406.424069:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786400406.424267:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392937984:0@lo:400:kworker.0 00000100:00100000:0.0:1786400406.424350:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392937600:0@lo:400:kworker.0 00010000:00080000:0.0:1786400406.424364:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282435c00 x1873176392938112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400406.424373:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392938112:0@lo:400:kworker.0 00000100:00100000:1.0:1786400406.424536:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392937728:0@lo:400:kworker.0 00000100:00100000:1.0:1786400406.424559:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392937472 00000100:00100000:1.0:1786400406.424563:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392937472 00000100:00100000:1.0:1786400406.424598:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1786400406.424605:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392937472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400406.424640:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392937472:12345-0@lo:400:kworker.0 Request processed in 35us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400406.424654:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:1.0:1786400406.424684:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400406.424689:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400406.425359:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392937472:0@lo:400:kworker.0 00000001:02000400:2.0:1786400406.665721:0:10005:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:20:04 (1786400404) === 00010000:00010000:0.0:1786400406.675058:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400406.933895:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400406.933920:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392938240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400406.933998:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400406.934108:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392938240 00000100:00100000:1.0:1786400406.934115:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392938240 00000100:00100000:1.0:1786400406.934166:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786400406.934177:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392938240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400406.934221:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400406.934268:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392938240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400406.934276:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1786400406.934318:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282437800 x1873176392938240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400406.934336:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392938240:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400407.699141:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400407.709371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400407.719496:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368784768 00000100:00100000:0.0:1786400407.719520:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368784768 00000100:00100000:0.0:1786400407.719658:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 210 00000100:00100000:0.0:1786400407.719669:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:8118:x1873176368784768:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786400407.719688:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400407.719706:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380030c00/0x49554f35ff0a51b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f4ff4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400407.719767:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380030c00/0x49554f35ff0a51b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4ff4 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400407.719779:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380030c00/0x49554f35ff0a51b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4ff4 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400407.719818:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030c00, rc 0) 00000100:00100000:0.0:1786400407.719893:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8118:x1873176368784768:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 225us (10534us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400407.719905:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 210 00000100:00100000:3.0:1786400407.732352:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400407.735461:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368784896 00000100:00100000:1.0:1786400407.735488:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368784896 00000100:00100000:1.0:1786400407.735564:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 211 00000100:00100000:1.0:1786400407.735576:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8118:x1873176368784896:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1786400407.736307:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8118:x1873176368784896:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 733us (3963us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400407.736315:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 211 00000100:00100000:3.0:1786400407.739871:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400407.739925:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368785024 00000100:00100000:2.0:1786400407.739935:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368785024 00000100:00100000:2.0:1786400407.740278:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 212 00000100:00100000:2.0:1786400407.740287:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8118:x1873176368785024:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786400407.740519:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8118:x1873176368785024:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 233us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.740529:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 212 00000100:00100000:3.0:1786400407.751437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400407.751581:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368785152 00000100:00100000:0.0:1786400407.751593:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368785152 00000100:00100000:0.0:1786400407.751654:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 213 00000100:00100000:0.0:1786400407.751664:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8122:x1873176368785152:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400407.752007:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8122:x1873176368785152:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 342us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400407.752016:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 213 00000100:00100000:3.0:1786400407.774023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400407.774395:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368785280 00000100:00100000:2.0:1786400407.774406:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368785280 00000100:00100000:2.0:1786400407.774488:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 214 00000100:00100000:2.0:1786400407.774499:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8122:x1873176368785280:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400407.775104:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8122:x1873176368785280:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 606us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.775113:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 214 00000100:00100000:3.0:1786400407.790852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400407.791078:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368785408 00000100:00100000:1.0:1786400407.791102:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368785408 00000100:00100000:1.0:1786400407.791179:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 215 00000100:00100000:1.0:1786400407.791191:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:8118:x1873176368785408:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786400407.791209:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400407.791230:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebe600/0x49554f35ff0a51b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f501e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400407.791260:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebe600/0x49554f35ff0a51b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f501e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400407.791273:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebe600/0x49554f35ff0a51b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f501e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400407.791283:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe600, rc 0) 00000100:00100000:1.0:1786400407.791341:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:8118:x1873176368785408:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 152us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400407.791348:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 215 00000100:00100000:3.0:1786400407.795192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400407.795493:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368785536 00000100:00100000:2.0:1786400407.795503:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368785536 00000100:00100000:2.0:1786400407.795571:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 216 00000100:00100000:2.0:1786400407.795579:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:8118:x1873176368785536:12345-192.168.201.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1786400407.795607:0:5811:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786400407.795631:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786400407.795634:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786400407.795637:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786400407.795642:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1786400407.798713:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:8118:x1873176368785536:12345-192.168.201.23@tcp:256:mount.lustre.0 Request processed in 3126us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.798728:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 216 00000100:00100000:3.0:1786400407.803159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400407.803265:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368785664 00000100:00100000:1.0:1786400407.803275:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368785664 00000100:00100000:1.0:1786400407.803332:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 217 00000100:00100000:1.0:1786400407.803342:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:8118:x1873176368785664:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786400407.803358:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400407.803375:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5025 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400407.803406:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400407.803417:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400407.803440:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf800, rc 0) 00000100:00100000:1.0:1786400407.803509:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8118:x1873176368785664:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 168us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400407.803517:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 217 00000100:00100000:3.0:1786400407.807838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400407.808231:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368785792 00000100:00100000:2.0:1786400407.808240:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368785792 00000100:00100000:2.0:1786400407.808290:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 218 00000100:00100000:2.0:1786400407.808297:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8118:x1873176368785792:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786400407.808652:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8118:x1873176368785792:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 353us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.808658:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 218 00000100:00100000:3.0:1786400407.811239:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400407.811400:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368785920 00000100:00100000:0.0:1786400407.811411:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368785920 00000100:00100000:0.0:1786400407.811473:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 219 00000100:00100000:0.0:1786400407.811483:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8118:x1873176368785920:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786400407.811716:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8118:x1873176368785920:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 233us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400407.811725:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 219 00000100:00100000:3.0:1786400407.816820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400407.817087:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368786048 00000100:00100000:1.0:1786400407.817098:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368786048 00000100:00100000:1.0:1786400407.817170:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 220 00000100:00100000:1.0:1786400407.817181:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8124:x1873176368786048:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400407.817438:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8124:x1873176368786048:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 259us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400407.817445:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 220 00000100:00100000:3.0:1786400407.824688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400407.825144:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368786176 00000100:00100000:1.0:1786400407.825154:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368786176 00000100:00100000:1.0:1786400407.825214:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 221 00000100:00100000:1.0:1786400407.825223:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8124:x1873176368786176:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400407.825461:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:8124:x1873176368786176:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 238us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400407.825469:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 221 00000100:00100000:3.0:1786400407.834793:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400407.834983:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368786304 00000100:00100000:0.0:1786400407.835006:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368786304 00000100:00100000:0.0:1786400407.835067:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:0.0:1786400407.835077:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1873176368786304:12345-192.168.201.23@tcp:38:mount.lustre.0 00010000:00080000:0.0:1786400407.835110:0:5818:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 70c60e7c-6fb5-4b8c-8c57-d94093690eb5@192.168.201.23@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:0.0:1786400407.835172:0:5818:0:(genops.c:1406:class_connect()) connect: client 70c60e7c-6fb5-4b8c-8c57-d94093690eb5, cookie 0x49554f35ff0a51c6 00000004:00100000:0.0:1786400407.835219:0:5818:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786400407.835472:0:5818:0:(import.c:65:import_set_state_nolock()) ffff9373bf3f7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400407.835564:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2358:x1873176368786304:12345-192.168.201.23@tcp:38:mount.lustre.0 Request processed in 487us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400407.835572:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1786400407.839578:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400407.839617:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400407.839652:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400407.839852:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368786688 00000100:00100000:2.0:1786400407.839863:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368786688 00000100:00100000:2.0:1786400407.839936:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368786560 00000100:00100000:2.0:1786400407.839940:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368786560 00000100:00100000:2.0:1786400407.839954:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368786432 00000100:00100000:2.0:1786400407.839957:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368786432 00000100:00100000:2.0:1786400407.839970:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:2.0:1786400407.839979:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368786688:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400407.840071:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368786688:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 92us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.840080:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:2.0:1786400407.840098:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1786400407.840104:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+7:8118:x1873176368786560:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786400407.840147:0:8098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786400407.840223:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+7:8118:x1873176368786560:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 119us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.840237:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1786400407.840250:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1786400407.840256:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:0:x1873176368786432:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786400407.840267:0:8098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786400407.840288:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:0:x1873176368786432:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.840294:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00080000:3.0:1786400407.840619:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400407.853227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400407.853365:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368786816 00000100:00100000:2.0:1786400407.853377:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368786816 00000100:00100000:2.0:1786400407.853448:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1786400407.853459:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:8118:x1873176368786816:12345-192.168.201.23@tcp:40:mount.lustre.0 00000100:00100000:2.0:1786400407.853568:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:8118:x1873176368786816:12345-192.168.201.23@tcp:40:mount.lustre.0 Request processed in 111us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.853576:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1786400407.862793:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400407.862835:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400407.862874:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400407.862958:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368787200 00000100:00100000:3.0:1786400407.862968:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368787200 00000100:00100000:3.0:1786400407.863038:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:3.0:1786400407.863057:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:8118:x1873176368787200:12345-192.168.201.23@tcp:33:mount.lustre.0 00000004:00200000:3.0:1786400407.863346:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1786400407.863488:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:8118:x1873176368787200:12345-192.168.201.23@tcp:33:mount.lustre.0 Request processed in 441us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400407.863497:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:1.0:1786400407.863673:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368786944 00000100:00100000:1.0:1786400407.863678:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368786944 00000100:00100000:1.0:1786400407.863709:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368787072 00000100:00100000:1.0:1786400407.863712:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368787072 00000100:00100000:1.0:1786400407.863724:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:1.0:1786400407.863729:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873176368786944:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1786400407.863796:0:6623:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 70c60e7c-6fb5-4b8c-8c57-d94093690eb5@192.168.201.23@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:1.0:1786400407.863821:0:6623:0:(genops.c:1406:class_connect()) connect: client 70c60e7c-6fb5-4b8c-8c57-d94093690eb5, cookie 0x49554f35ff0a51cd 00002000:00100000:1.0:1786400407.863832:0:6623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 70c60e7c-6fb5-4b8c-8c57-d94093690eb5/ffff9373bf7d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786400407.863856:0:6623:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786400407.864074:0:6623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786400407.864101:0:6623:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400407.864129:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2358:x1873176368786944:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 399us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400407.864137:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:1.0:1786400407.864150:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:1.0:1786400407.864154:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873176368787072:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1786400407.864170:0:6623:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 70c60e7c-6fb5-4b8c-8c57-d94093690eb5@192.168.201.23@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:1.0:1786400407.864185:0:6623:0:(genops.c:1406:class_connect()) connect: client 70c60e7c-6fb5-4b8c-8c57-d94093690eb5, cookie 0x49554f35ff0a51d4 00002000:00100000:1.0:1786400407.864190:0:6623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 70c60e7c-6fb5-4b8c-8c57-d94093690eb5/ffff9373bf7d6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786400407.864197:0:6623:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786400407.864319:0:6623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786400407.864334:0:6623:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400407.864358:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2358:x1873176368787072:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 202us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400407.864365:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:0.0:1786400407.956355:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400407.956380:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392938368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400407.956461:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400407.956599:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392938368 00000100:00100000:2.0:1786400407.956607:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392938368 00000100:00100000:2.0:1786400407.956660:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786400407.956670:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392938368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400407.956706:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400407.956787:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392938368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400407.956795:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1786400407.957019:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe41880 x1873176392938368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400407.957041:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392938368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400408.723260:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786400409.018068:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00000001:00100000:3.0:1786400409.573179:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00010000:00010000:0.0:1786400409.747268:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786400410.095121:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00010000:00010000:0.0:1786400410.794242:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400411.540307:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392938496:0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.540382:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400411.540503:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392939008:0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.540531:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400411.540558:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786400411.540564:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392938624:0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.540583:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400411.540598:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392939136:0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.540622:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400411.540647:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392938752:0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.540668:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400411.540695:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400411.540700:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392938880:0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.540719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400411.540771:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392939008 00000100:00100000:0.0:1786400411.540778:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392939008 00000100:00100000:0.0:1786400411.540828:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392938624 00000100:00100000:0.0:1786400411.540831:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392938624 00000100:00100000:0.0:1786400411.540841:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392938752 00000100:00100000:0.0:1786400411.540843:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392938752 00000100:00100000:0.0:1786400411.540857:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786400411.540864:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392939008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.541188:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392939008:12345-0@lo:400:kworker.0 Request processed in 322us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400411.541197:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786400411.541214:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786400411.541220:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392938624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.541247:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392938624:12345-0@lo:400:kworker.0 Request processed in 28us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400411.541253:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786400411.541263:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786400411.541268:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392938752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.541296:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392938752:12345-0@lo:400:kworker.0 Request processed in 27us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400411.541301:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786400411.541320:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392939136 00000100:00100000:0.0:1786400411.541324:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392939136 00000100:00100000:0.0:1786400411.541348:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392938880 00000100:00100000:0.0:1786400411.541351:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392938880 00000100:00100000:0.0:1786400411.541377:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786400411.541383:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392939136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.541414:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392939136:12345-0@lo:400:kworker.0 Request processed in 31us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400411.541419:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786400411.541430:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786400411.541541:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392938496 00000100:00100000:2.0:1786400411.541546:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392938496 00000100:00100000:2.0:1786400411.541572:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1786400411.541578:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392938496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400411.541609:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392938496:12345-0@lo:400:kworker.0 Request processed in 32us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400411.541615:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1786400411.541706:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392938624:0@lo:400:kworker.0 00010000:00080000:1.0:1786400411.541720:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c1c00 x1873176392939136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400411.541767:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392939136:0@lo:400:kworker.0 00000100:00100000:1.0:1786400411.541779:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392938496:0@lo:400:kworker.0 00000100:00100000:1.0:1786400411.541789:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392939008:0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.541890:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392938880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400411.542060:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392938880:12345-0@lo:400:kworker.0 Request processed in 172us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400411.542067:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1786400411.542090:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786400411.542094:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400411.542097:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786400411.545230:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c2300 x1873176392938880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400411.545249:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392938880:0@lo:400:kworker.0 00000100:00100000:1.0:1786400411.545263:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392938752:0@lo:400:kworker.0 00010000:00010000:0.0:1786400411.795247:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400412.051134:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400412.051158:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392939264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400412.051233:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400412.051440:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392939264 00000100:00100000:1.0:1786400412.051449:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392939264 00000100:00100000:1.0:1786400412.051503:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786400412.051512:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392939264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400412.051548:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400412.051601:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392939264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400412.051608:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1786400412.051682:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282434380 x1873176392939264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400412.051700:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392939264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400412.822247:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400412.973002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400412.973057:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400412.973099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400412.973126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400412.973150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400412.973338:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368787584 00000100:00100000:2.0:1786400412.973350:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368787584 00000100:00100000:2.0:1786400412.973431:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368787456 00000100:00100000:2.0:1786400412.973435:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368787456 00000100:00100000:2.0:1786400412.973457:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:2.0:1786400412.973466:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368787584:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400412.973540:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368787584:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 74us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400412.973548:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:2.0:1786400412.973565:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:2.0:1786400412.973572:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2360:x1873176368787456:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400412.973596:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2360:x1873176368787456:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400412.973618:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:0.0:1786400412.974365:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368787328 00000100:00100000:0.0:1786400412.974371:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368787328 00000100:00100000:0.0:1786400412.974425:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 223 00000100:00100000:0.0:1786400412.974432:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368787328:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400412.974467:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368787328:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 35us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400412.974473:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 223 00000100:00100000:0.0:1786400412.974507:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368787840 00000100:00100000:0.0:1786400412.974511:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368787840 00000100:00100000:0.0:1786400412.974535:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368787712 00000100:00100000:0.0:1786400412.974539:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368787712 00000100:00100000:0.0:1786400412.974555:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:0.0:1786400412.974562:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368787840:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400412.974602:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368787840:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 40us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400412.974609:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:0.0:1786400412.974621:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:0.0:1786400412.974627:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368787712:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400412.974649:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368787712:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 23us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400412.974655:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00080000:1.0:1786400412.975244:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400412.975249:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400412.975251:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400413.076244:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400413.076269:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392939392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400413.076339:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400413.076882:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392939392 00000100:00100000:3.0:1786400413.076891:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392939392 00000100:00100000:3.0:1786400413.076994:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786400413.077004:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392939392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400413.077054:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400413.077105:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392939392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400413.077111:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1786400413.077142:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe40000 x1873176392939392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400413.077156:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392939392:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786400413.077277:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400413.844435:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400414.466657:0:10206:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1786400414.868248:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400415.890995:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400416.661596:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392939648:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.661659:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400416.661703:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392940160:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.661761:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400416.661792:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786400416.661798:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392939520:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.661822:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400416.661853:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392940032:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.661872:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400416.661897:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392939776:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.661918:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400416.661936:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400416.661942:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392939904:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.661972:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400416.662004:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392939648 00000100:00100000:1.0:1786400416.662011:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392939648 00000100:00100000:1.0:1786400416.662065:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392940032 00000100:00100000:1.0:1786400416.662069:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392940032 00000100:00100000:1.0:1786400416.662090:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392939776 00000100:00100000:1.0:1786400416.662093:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392939776 00000100:00100000:1.0:1786400416.662109:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786400416.662117:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392939648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662169:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392939648:12345-0@lo:400:kworker.0 Request processed in 52us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400416.662176:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786400416.662192:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786400416.662197:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392940032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662233:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392940032:12345-0@lo:400:kworker.0 Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400416.662240:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786400416.662251:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786400416.662257:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392939776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662285:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392939776:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400416.662291:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786400416.662308:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392940160 00000100:00100000:1.0:1786400416.662311:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392940160 00000100:00100000:1.0:1786400416.662334:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392939904 00000100:00100000:1.0:1786400416.662337:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392939904 00000100:00100000:1.0:1786400416.662351:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786400416.662357:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392940160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662384:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392940160:12345-0@lo:400:kworker.0 Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400416.662390:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786400416.662401:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786400416.662407:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392939904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662438:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392939904:12345-0@lo:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400416.662444:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786400416.662458:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392939520 00000100:00100000:1.0:1786400416.662461:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392939520 00000100:00100000:1.0:1786400416.662482:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1786400416.662488:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392939520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662524:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392939520:12345-0@lo:400:kworker.0 Request processed in 37us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400416.662531:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1786400416.662569:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400416.662574:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400416.662576:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786400416.662603:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282434a80 x1873176392939904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400416.662616:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392939904:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662626:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392939776:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662652:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392939520:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662662:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392940032:0@lo:400:kworker.0 00000100:00100000:1.0:1786400416.662670:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392939648:0@lo:400:kworker.0 00010000:00080000:1.0:1786400416.662679:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937282435500 x1873176392940160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400416.662688:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392940160:0@lo:400:kworker.0 00010000:00010000:1.0:1786400416.920990:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400417.186898:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400417.186922:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392940288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400417.186991:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400417.214665:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392940288 00000100:00100000:1.0:1786400417.214679:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392940288 00000100:00100000:1.0:1786400417.214768:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786400417.214780:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392940288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400417.214825:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400417.214924:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392940288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (27932us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400417.214932:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1786400417.215073:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b79c5180 x1873176392940288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400417.215095:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392940288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400417.939114:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400418.087652:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400418.087685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400418.087719:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400418.087780:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400418.087809:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400418.087847:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368788480 00000100:00100000:1.0:1786400418.087856:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368788480 00000100:00100000:1.0:1786400418.087911:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368788352 00000100:00100000:1.0:1786400418.087914:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368788352 00000100:00100000:1.0:1786400418.087934:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:1.0:1786400418.087944:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368788480:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400418.088014:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368788480:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400418.088023:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:1.0:1786400418.088040:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:1.0:1786400418.088046:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368788352:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400418.088072:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368788352:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400418.088078:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:1.0:1786400418.088098:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368788224 00000100:00100000:1.0:1786400418.088102:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368788224 00000100:00100000:1.0:1786400418.088128:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368788096 00000100:00100000:1.0:1786400418.088139:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368788096 00000100:00100000:1.0:1786400418.088161:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:1.0:1786400418.088166:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368788224:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400418.088195:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368788224:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400418.088201:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:1.0:1786400418.088211:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:1.0:1786400418.088217:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368788096:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400418.088234:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368788096:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 18us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400418.088239:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00080000:1.0:1786400418.088255:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786400418.088259:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400418.088261:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400418.088480:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368787968 00000100:00100000:2.0:1786400418.088485:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368787968 00000100:00100000:2.0:1786400418.088519:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 225 00000100:00100000:2.0:1786400418.088526:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368787968:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400418.088553:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368787968:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400418.088559:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 225 00000100:00100000:2.0:1786400418.200075:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400418.200099:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392940416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400418.200171:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400418.200335:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392940416 00000100:00100000:3.0:1786400418.200343:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392940416 00000100:00100000:3.0:1786400418.200413:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786400418.200423:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392940416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400418.200459:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400418.200504:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392940416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400418.200512:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1786400418.200575:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400418.200616:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe40000 x1873176392940416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400418.200636:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392940416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400418.977115:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400419.987270:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400421.013959:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400421.780217:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392940672:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780290:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400421.780341:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392941184:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780368:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400421.780399:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786400421.780405:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392940544:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780436:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400421.780458:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392941056:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780481:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400421.780507:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392940800:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780531:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400421.780565:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400421.780571:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392940928:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780611:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400421.780645:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392940672 00000100:00100000:1.0:1786400421.780652:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392940672 00000100:00100000:1.0:1786400421.780698:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392941056 00000100:00100000:1.0:1786400421.780701:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392941056 00000100:00100000:1.0:1786400421.780721:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392940800 00000100:00100000:1.0:1786400421.780725:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392940800 00000100:00100000:1.0:1786400421.780787:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786400421.780808:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392940672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780860:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392940672:12345-0@lo:400:kworker.0 Request processed in 53us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400421.780866:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786400421.780884:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786400421.780891:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392941056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780916:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392941056:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400421.780922:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786400421.780933:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786400421.780939:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392940800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.780967:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392940800:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400421.780973:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786400421.780989:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392941184 00000100:00100000:1.0:1786400421.780992:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392941184 00000100:00100000:1.0:1786400421.781015:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392940928 00000100:00100000:1.0:1786400421.781019:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392940928 00000100:00100000:1.0:1786400421.781043:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786400421.781049:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392941184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.781081:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392941184:12345-0@lo:400:kworker.0 Request processed in 32us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400421.781085:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786400421.781095:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786400421.781101:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392940928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.781126:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392940928:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400421.781131:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786400421.781147:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392940544 00000100:00100000:1.0:1786400421.781150:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392940544 00000100:00100000:1.0:1786400421.781170:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1786400421.781176:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392940544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.781201:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392940544:12345-0@lo:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400421.781206:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:1.0:1786400421.781242:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400421.781246:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400421.781249:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786400421.781276:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b79c5f80 x1873176392940928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400421.781289:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392940928:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.781299:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392940800:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.781325:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392940544:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.781346:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392941056:0@lo:400:kworker.0 00000100:00100000:1.0:1786400421.781354:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392940672:0@lo:400:kworker.0 00010000:00080000:1.0:1786400421.781363:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b79c4e00 x1873176392941184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400421.781370:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392941184:0@lo:400:kworker.0 00010000:00010000:0.0:1786400422.044392:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400422.296527:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400422.296550:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392941312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400422.296617:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400422.296689:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392941312 00000100:00100000:0.0:1786400422.296696:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392941312 00000100:00100000:0.0:1786400422.296777:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786400422.296787:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392941312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400422.297023:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400422.297082:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392941312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 296us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400422.297101:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1786400422.297142:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7a19880 x1873176392941312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400422.297158:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392941312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786400423.064529:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400423.200370:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400423.200427:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400423.200496:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368788608 00000100:00100000:0.0:1786400423.200506:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368788608 00000100:00100000:0.0:1786400423.200572:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 227 00000100:00100000:0.0:1786400423.200584:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368788608:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400423.200660:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368788608:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400423.200667:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 227 00000100:00100000:2.0:1786400423.201170:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368788736 00000100:00100000:2.0:1786400423.201176:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368788736 00000100:00100000:2.0:1786400423.201230:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:2.0:1786400423.201248:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368788736:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400423.201290:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368788736:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 45us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400423.201297:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00080000:0.0:1786400423.201458:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400423.211312:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400423.211368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400423.211402:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368788992 00000100:00100000:1.0:1786400423.211410:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368788992 00000100:00100000:1.0:1786400423.211463:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368789120 00000100:00100000:1.0:1786400423.211467:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368789120 00000100:00100000:1.0:1786400423.211487:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:1.0:1786400423.211496:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368788992:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400423.211763:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368788992:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 266us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400423.211771:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:1.0:1786400423.211799:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:1.0:1786400423.211806:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368789120:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400423.211833:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368789120:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400423.211839:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00080000:1.0:1786400423.211856:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400423.211868:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400423.220839:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400423.220976:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368788864 00000100:00100000:3.0:1786400423.220988:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368788864 00000100:00100000:3.0:1786400423.221056:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:3.0:1786400423.221067:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2361:x1873176368788864:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400423.221162:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2361:x1873176368788864:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 97us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400423.221170:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00080000:1.0:1786400423.221356:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400423.322964:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392941440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400423.323033:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400423.323110:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392941440 00000100:00100000:0.0:1786400423.323117:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392941440 00000100:00100000:0.0:1786400423.323163:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786400423.323171:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392941440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400423.323205:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400423.323254:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392941440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400423.323261:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1786400423.323279:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786400423.323303:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7a19880 x1873176392941440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400423.323330:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392941440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400424.082971:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400425.106913:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400426.135539:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400426.904512:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400426.904586:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400426.904620:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392941696:0@lo:400:kworker.0 00000100:00100000:0.0:1786400426.904733:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400426.904830:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392941696 00000100:00100000:0.0:1786400426.904838:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392941696 00000100:00100000:0.0:1786400426.904892:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786400426.904902:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392941696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400426.904959:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392941696:12345-0@lo:400:kworker.0 Request processed in 57us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400426.904966:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786400426.905007:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392941696:0@lo:400:kworker.0 00000100:00100000:1.0:1786400426.912901:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392941568:0@lo:400:kworker.0 00000100:00100000:1.0:1786400426.912985:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400426.913057:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392941568 00000100:00100000:1.0:1786400426.913066:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392941568 00000100:00100000:1.0:1786400426.913114:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1786400426.913122:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392941568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400426.913191:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392941568:12345-0@lo:400:kworker.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400426.913198:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1786400426.913248:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392941568:0@lo:400:kworker.0 00000100:00100000:3.0:1786400426.913816:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392941824:0@lo:400:kworker.0 00000100:00100000:3.0:1786400426.913853:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400426.913880:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400426.913886:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392941952:0@lo:400:kworker.0 00000100:00100000:3.0:1786400426.913912:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400426.913943:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392941824 00000100:00100000:3.0:1786400426.913947:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392941824 00000100:00100000:3.0:1786400426.913989:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1786400426.913997:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392941824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400426.914036:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392941824:12345-0@lo:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400426.914043:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1786400426.914062:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400426.914083:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392941824:0@lo:400:kworker.0 00000100:00100000:0.0:1786400426.914402:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392942080:0@lo:400:kworker.0 00000100:00100000:0.0:1786400426.914432:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400426.914462:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400426.914468:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392942208:0@lo:400:kworker.0 00000100:00100000:0.0:1786400426.914489:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400426.914902:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392941952 00000100:00100000:1.0:1786400426.914908:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392941952 00000100:00100000:1.0:1786400426.914949:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392942208 00000100:00100000:1.0:1786400426.914953:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392942208 00000100:00100000:1.0:1786400426.914973:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786400426.914980:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392941952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400426.915029:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392941952:12345-0@lo:400:kworker.0 Request processed in 49us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400426.915036:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786400426.915050:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786400426.915056:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392942208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400426.915089:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392942208:12345-0@lo:400:kworker.0 Request processed in 33us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400426.915109:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786400426.915128:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392942080 00000100:00100000:1.0:1786400426.915132:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392942080 00000100:00100000:1.0:1786400426.915159:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1786400426.915164:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392942080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400426.915208:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392942080:12345-0@lo:400:kworker.0 Request processed in 44us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400426.915214:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1786400426.915233:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786400426.915237:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400426.915239:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786400426.915257:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe41f80 x1873176392942208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400426.915268:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392942208:0@lo:400:kworker.0 00000100:00100000:1.0:1786400426.915277:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392942080:0@lo:400:kworker.0 00010000:00080000:1.0:1786400426.915302:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe42d80 x1873176392941952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400426.915311:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392941952:0@lo:400:kworker.0 00010000:00010000:3.0:1786400427.155145:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400427.410988:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392942336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400427.411073:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400427.411332:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392942336 00000100:00100000:0.0:1786400427.411340:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392942336 00000100:00100000:0.0:1786400427.411399:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786400427.411408:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392942336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400427.411441:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400427.411501:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392942336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400427.411524:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1786400427.411617:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7a19180 x1873176392942336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400427.411642:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392942336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786400428.178960:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400428.322894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400428.322938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400428.323002:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368789632 00000100:00100000:0.0:1786400428.323013:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368789632 00000100:00100000:0.0:1786400428.323079:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368789760 00000100:00100000:0.0:1786400428.323083:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368789760 00000100:00100000:0.0:1786400428.323101:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1786400428.323111:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2358:x1873176368789632:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:0.0:1786400428.323142:0:6622:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a51cd 00000100:00080000:0.0:1786400428.323161:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786400428.323203:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1786400428.323549:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+2:2358:x1873176368789632:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 438us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400428.323557:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1786400428.323574:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:0.0:1786400428.323580:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2358:x1873176368789760:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:0.0:1786400428.323591:0:6622:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a51d4 00000100:00080000:0.0:1786400428.323597:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786400428.323618:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1786400428.323851:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+2:2358:x1873176368789760:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 271us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400428.323858:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00010000:00010000:0.0:1786400428.323881:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400428.323984:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786400428.325316:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400428.325325:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400428.327691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400428.327735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400428.327786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400428.327835:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368789504 00000100:00100000:0.0:1786400428.327856:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368789504 00000100:00100000:0.0:1786400428.327912:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368789376 00000100:00100000:0.0:1786400428.327915:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368789376 00000100:00100000:0.0:1786400428.327940:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:0.0:1786400428.327950:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368789504:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400428.328024:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368789504:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400428.328032:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:0.0:1786400428.328049:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 89 00000100:00100000:0.0:1786400428.328056:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368789376:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400428.328081:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368789376:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400428.328088:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 89 00000100:00080000:0.0:1786400428.328110:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400428.328650:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368789248 00000100:00100000:1.0:1786400428.328664:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368789248 00000100:00100000:1.0:1786400428.328698:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 229 00000100:00100000:1.0:1786400428.328706:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368789248:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400428.328758:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368789248:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 53us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400428.328765:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 229 00000100:00100000:0.0:1786400428.435000:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392942464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400428.435071:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400428.435146:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392942464 00000100:00100000:0.0:1786400428.435153:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392942464 00000100:00100000:0.0:1786400428.435220:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786400428.435228:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392942464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400428.435265:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400428.435306:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392942464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400428.435313:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1786400428.435333:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786400428.435376:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7a1b800 x1873176392942464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400428.435394:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392942464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400429.203937:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786400429.574812:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00000020:00000080:2.0:1786400429.574823:0:6647:0:(genops.c:906:class_export_put()) final put ffff9373bf7d4000/70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00000020:00000080:1.0:1786400429.574957:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf7d4000/70c60e7c-6fb5-4b8c-8c57-d94093690eb5 for lustre-OST0000 00000020:00000080:1.0:1786400429.575008:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373bf7d3800 for lustre-OST0000 00010000:00010000:0.0:1786400430.227180:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786400430.594670:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00000020:00000080:3.0:1786400430.594680:0:7536:0:(genops.c:906:class_export_put()) final put ffff9373bf7d6800/70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00000020:00000080:3.0:1786400430.594707:0:10440:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf7d6800/70c60e7c-6fb5-4b8c-8c57-d94093690eb5 for lustre-OST0001 00000020:00000080:3.0:1786400430.594763:0:10440:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373bf7d5800 for lustre-OST0001 00010000:00010000:0.0:1786400431.251226:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400432.022815:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392942720:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.022888:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400432.023475:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392943232:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.023510:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400432.023548:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786400432.023555:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392942592:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.023592:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400432.023808:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392943104:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.023835:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400432.023866:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392942848:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.023888:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400432.023907:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400432.023912:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392942976:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.023933:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400432.025214:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392942720 00000100:00100000:0.0:1786400432.025227:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392942720 00000100:00100000:0.0:1786400432.025273:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392943104 00000100:00100000:0.0:1786400432.025276:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392943104 00000100:00100000:0.0:1786400432.028588:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392942848 00000100:00100000:0.0:1786400432.028597:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392942848 00000100:00100000:0.0:1786400432.028622:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786400432.028647:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392942720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.029563:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392942720:12345-0@lo:400:kworker.0 Request processed in 915us (6672us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400432.029581:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786400432.029604:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786400432.029612:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392943104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.029655:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392943104:12345-0@lo:400:kworker.0 Request processed in 45us (5819us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400432.029662:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786400432.029683:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786400432.029690:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392942848:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786400432.030021:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400432.030126:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392943104:0@lo:400:kworker.0 00000100:00100000:3.0:1786400432.030139:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392942720:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.030246:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392942848:12345-0@lo:400:kworker.0 Request processed in 556us (6355us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400432.030253:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1786400432.030429:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392942848:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.030473:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392943232 00000100:00100000:0.0:1786400432.030479:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392943232 00000100:00100000:0.0:1786400432.030527:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392942976 00000100:00100000:0.0:1786400432.030531:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392942976 00000100:00100000:0.0:1786400432.030549:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786400432.030555:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392943232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.030607:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392943232:12345-0@lo:400:kworker.0 Request processed in 51us (7096us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400432.031135:0:6623:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1786400432.031146:0:6623:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:3.0:1786400432.031255:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373a0c70000 x1873176392943232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400432.031267:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392943232:0@lo:400:kworker.0 00000100:00100000:0.0:1786400432.031353:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1786400432.031414:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400432.031418:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400432.032601:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786400432.035121:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392942976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400432.035240:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392942976:12345-0@lo:400:kworker.0 Request processed in 2629us (11305us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400432.035251:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1786400432.035430:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7a19180 x1873176392942976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400432.035446:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392942976:0@lo:400:kworker.0 00000100:00100000:1.0:1786400432.035897:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392942592 00000100:00100000:1.0:1786400432.035906:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392942592 00000100:00100000:1.0:1786400432.035964:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1786400432.035972:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392942592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400432.036037:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392942592:12345-0@lo:400:kworker.0 Request processed in 65us (12444us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400432.036044:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1786400432.036381:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392942592:0@lo:400:kworker.0 00010000:00010000:0.0:1786400432.279190:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400432.531849:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392943360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400432.531917:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400432.532626:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392943360 00000100:00100000:1.0:1786400432.532634:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392943360 00000100:00100000:1.0:1786400432.532681:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786400432.532691:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392943360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400432.532768:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400432.532814:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392943360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400432.532821:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1786400432.533607:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b79c5c00 x1873176392943360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400432.533626:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392943360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400433.298997:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400433.442926:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400433.442979:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400433.443014:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400433.443045:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368790016 00000100:00100000:1.0:1786400433.443055:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368790016 00000100:00100000:1.0:1786400433.443111:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368790144 00000100:00100000:1.0:1786400433.443114:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368790144 00000100:00100000:1.0:1786400433.443137:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:1.0:1786400433.443146:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368790016:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400433.443221:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368790016:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 75us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400433.443228:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:1.0:1786400433.443245:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:1.0:1786400433.443252:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368790144:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400433.443278:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368790144:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400433.443285:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00080000:1.0:1786400433.443301:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400433.443535:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368789888 00000100:00100000:3.0:1786400433.443540:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368789888 00000100:00100000:3.0:1786400433.443628:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 231 00000100:00100000:3.0:1786400433.443636:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368789888:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400433.443671:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368789888:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 35us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400433.443678:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 231 00000100:00100000:1.0:1786400433.563356:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400433.563383:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392943488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400433.563454:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400433.563626:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392943488 00000100:00100000:2.0:1786400433.563635:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392943488 00000100:00100000:2.0:1786400433.563690:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786400433.563701:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392943488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400433.563756:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400433.563810:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392943488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400433.563818:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1786400433.563872:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe43b80 x1873176392943488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400433.563894:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392943488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786400434.327917:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400434.904930:0:10914:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1786400435.349210:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400436.377303:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400437.145879:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392943616:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.145950:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400437.145990:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392944128:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146015:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400437.146042:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786400437.146049:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392943744:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146072:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400437.146090:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392944256:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146115:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400437.146143:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392943872:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146162:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400437.146176:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400437.146181:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392944000:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146196:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400437.146220:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392943616 00000100:00100000:0.0:1786400437.146226:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392943616 00000100:00100000:0.0:1786400437.146269:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1786400437.146277:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392943616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146320:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392943616:12345-0@lo:400:kworker.0 Request processed in 44us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400437.146328:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1786400437.146355:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392944128 00000100:00100000:0.0:1786400437.146358:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392944128 00000100:00100000:0.0:1786400437.146384:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392943744 00000100:00100000:0.0:1786400437.146394:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392943744 00000100:00100000:0.0:1786400437.146405:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392943872 00000100:00100000:0.0:1786400437.146407:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392943872 00000100:00100000:0.0:1786400437.146418:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1786400437.146423:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392944128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146449:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392944128:12345-0@lo:400:kworker.0 Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400437.146455:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1786400437.146463:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786400437.146468:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392943744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146499:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392943744:12345-0@lo:400:kworker.0 Request processed in 30us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400437.146505:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786400437.146514:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1786400437.146520:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392943872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146548:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392943872:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400437.146554:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1786400437.146574:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392944256 00000100:00100000:0.0:1786400437.146577:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392944256 00000100:00100000:0.0:1786400437.146596:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392944000 00000100:00100000:0.0:1786400437.146599:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392944000 00000100:00100000:0.0:1786400437.146615:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786400437.146620:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392944256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146648:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392944256:12345-0@lo:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400437.146654:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786400437.146669:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786400437.146674:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392944000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146696:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392944000:12345-0@lo:400:kworker.0 Request processed in 22us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400437.146702:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786400437.146759:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392943744:0@lo:400:kworker.0 00010000:00080000:0.0:1786400437.146772:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75ad880 x1873176392944256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400437.146783:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392944256:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146791:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392943616:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146799:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392944128:0@lo:400:kworker.0 00000100:00080000:0.0:1786400437.146819:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786400437.146823:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400437.146826:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786400437.146840:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75ae300 x1873176392944000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400437.146849:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392944000:0@lo:400:kworker.0 00000100:00100000:0.0:1786400437.146856:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392943872:0@lo:400:kworker.0 00010000:00010000:0.0:1786400437.396095:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400437.655161:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400437.655185:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392944384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400437.655254:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400437.655364:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392944384 00000100:00100000:0.0:1786400437.655372:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392944384 00000100:00100000:0.0:1786400437.655424:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786400437.655434:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392944384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400437.655468:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400437.655538:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392944384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400437.655546:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1786400437.655587:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e38e00 x1873176392944384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400437.655606:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392944384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786400438.427051:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400438.568221:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400438.568358:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368790400 00000100:00100000:0.0:1786400438.568370:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368790400 00000100:00100000:0.0:1786400438.568448:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:0.0:1786400438.568468:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2360:x1873176368790400:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400438.568549:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2360:x1873176368790400:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400438.568557:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:1.0:1786400438.568899:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400438.568937:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400438.569005:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368790272 00000100:00100000:0.0:1786400438.569010:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368790272 00000100:00100000:0.0:1786400438.569047:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 233 00000100:00100000:0.0:1786400438.569054:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368790272:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400438.569096:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368790272:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400438.569103:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 233 00000100:00100000:0.0:1786400438.569130:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368790528 00000100:00100000:0.0:1786400438.569132:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368790528 00000100:00100000:0.0:1786400438.569161:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:0.0:1786400438.569167:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368790528:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400438.569194:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368790528:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400438.569209:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00080000:3.0:1786400438.569827:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1786400438.646360:0:11062:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff49442a30 00000020:00000080:1.0:1786400438.646377:0:11062:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1786400438.646381:0:11062:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1786400438.646388:0:11062:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff49444cc0 20000000:00000080:1.0:1786400438.646394:0:11062:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9373b9c20800 uarg=0000000000000000 20000000:01000000:1.0:1786400438.646433:0:11062:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1786400438.646438:0:11062:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1786400438.646443:0:11062:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1786400438.647682:0:11063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1786400438.647999:0:11062:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1786400438.653617:0:11062:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786400438.653655:0:11062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.653681:0:11062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.653690:0:11062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.653697:0:11062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.653724:0:11062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.653731:0:11062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.653926:0:11062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.654208:0:11062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.654225:0:11062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 12 pid: 5810 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.654242:0:11062:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392944512:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400438.654402:0:11062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.654424:0:11062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 18 pid: 5811 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.654434:0:11062:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392944640:0@lo:104: 00000100:00100000:2.0:1786400438.654491:0:11062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400438.654558:0:11062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.654566:0:11062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 18 pid: 5809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.654574:0:11062:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392944768:0@lo:104: 00000100:00100000:2.0:1786400438.654592:0:11062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400438.654854:0:11062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.654863:0:11062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 18 pid: 5810 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.654872:0:11062:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392944896:0@lo:104: 00000100:00100000:2.0:1786400438.654895:0:11062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400438.655059:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392944640 00000100:00100000:1.0:1786400438.655067:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392944640 00000100:00100000:1.0:1786400438.655110:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392944768 00000100:00100000:1.0:1786400438.655113:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392944768 00000100:00100000:1.0:1786400438.655130:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786400438.655139:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+4:11062:x1873176392944640:12345-0@lo:104: 00010000:00010000:1.0:1786400438.655152:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655200:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400438.655207:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+4:11062:x1873176392944640:12345-0@lo:104: Request processed in 68us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400438.655213:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786400438.655230:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786400438.655236:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:11062:x1873176392944768:12345-0@lo:104: 00010000:00010000:1.0:1786400438.655243:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655275:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786400438.655287:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:11062:x1873176392944768:12345-0@lo:104: Request processed in 52us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400438.655293:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1786400438.655309:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400438.655314:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655322:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400438.655326:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655334:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400438.655342:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400438.655348:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786400438.655378:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655385:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400438.655403:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655409:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f5a00/0x49554f35ff0a51a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a51aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655422:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400438.655425:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655441:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fda00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400438.655444:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655451:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400438.655467:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400438.655473:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786400438.655485:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655491:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400438.655505:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655511:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c21fda00/0x49554f35ff0a5195 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a519c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655520:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400438.655522:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400438.655523:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400438.655529:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400438.655541:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392945024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400438.655570:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400438.655602:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392945152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400438.655635:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400438.655665:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392945024 00000100:00100000:1.0:1786400438.655668:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392945024 00010000:00010000:1.0:1786400438.655683:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 19 pid: 5811 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400438.655700:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392945152 00000100:00100000:1.0:1786400438.655702:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392945152 00010000:00010000:1.0:1786400438.655709:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 20 pid: 5809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400438.655719:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786400438.655724:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+20:3316:x1873176392945024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400438.655732:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400438.655754:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 20 pid: 5811 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655763:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 20 pid: 5811 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655780:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400438.655802:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+20:3316:x1873176392945024:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400438.655808:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786400438.655843:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786400438.655848:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392945152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400438.655854:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400438.655858:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 19 pid: 5809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655876:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 19 pid: 5809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.655885:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400438.655909:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392945152:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400438.655915:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786400438.655953:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392945152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400438.655976:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392945024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400438.656232:0:11062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.656243:0:11062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 12 pid: 5811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.656253:0:11062:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392945280:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400438.656300:0:11062:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8540 going to sleep for 11 seconds 00010000:00010000:2.0:1786400438.656312:0:11062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f4c00/0x49554f35ff0a51aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a51a3 expref: 18 pid: 5811 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.656322:0:11062:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392944640:0@lo:104: 00010000:00010000:2.0:1786400438.656330:0:11062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f4a00/0x49554f35ff0a519c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a5195 expref: 17 pid: 5809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.656337:0:11062:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392944768:0@lo:104: 00000100:00100000:1.0:1786400438.656731:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392944896 00000100:00100000:1.0:1786400438.656765:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392944896 00000100:00100000:1.0:1786400438.656792:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786400438.656798:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:11062:x1873176392944896:12345-0@lo:104: 00010000:00010000:1.0:1786400438.656808:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.656852:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400438.656858:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+3:11062:x1873176392944896:12345-0@lo:104: Request processed in 60us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400438.656864:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1786400438.656879:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400438.656884:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.656891:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5c00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400438.656894:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.656908:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400438.656916:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400438.656921:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786400438.656944:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.656951:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400438.656964:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.656970:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f5c00/0x49554f35ff0a5187 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a518e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.656986:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400438.656988:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400438.656990:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400438.657005:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392945408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400438.657029:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400438.657055:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392945408 00000100:00100000:1.0:1786400438.657058:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392945408 00010000:00010000:1.0:1786400438.657070:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 17 pid: 5810 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400438.657087:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786400438.657092:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3318:x1873176392945408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400438.657106:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400438.657110:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 17 pid: 5810 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.657117:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 17 pid: 5810 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400438.657127:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400438.657151:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3318:x1873176392945408:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400438.657156:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786400438.657181:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392945408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400438.657255:0:11062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fdc00/0x49554f35ff0a518e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a5187 expref: 16 pid: 5810 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.657265:0:11062:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392944896:0@lo:104: 00000100:00100000:1.0:1786400438.658286:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400438.658343:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368790656 00000100:00100000:3.0:1786400438.658350:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368790656 00010000:00010000:3.0:1786400438.658374:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 13 pid: 5810 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400438.658414:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:3.0:1786400438.658421:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368790656:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400438.658433:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400438.658438:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 13 pid: 5810 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400438.658449:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 13 pid: 5810 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400438.658475:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400438.658515:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368790656:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400438.658521:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00010000:00010000:0.0:1786400438.659223:0:11062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebf800/0x49554f35ff0a51bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5025 expref: 12 pid: 5810 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400438.659237:0:11062:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392944512:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400438.661988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400438.662096:0:11062:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11062:1873176392945280:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400438.662145:0:11062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.662204:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368790784 00000100:00100000:2.0:1786400438.662213:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368790784 00010000:00010000:2.0:1786400438.662253:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 12 pid: 5811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400438.662289:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:2.0:1786400438.662299:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:2362:x1873176368790784:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400438.662312:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400438.662318:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 12 pid: 5811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662328:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 12 pid: 5811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662347:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fd200/0x49554f35ff0a5180 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fed expref: 12 pid: 5811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662376:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662383:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662396:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662404:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662411:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662417:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662423:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebec00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400438.662428:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.662436:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400438.666767:0:11062:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400438.666792:0:11062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.669326:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.669346:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a51db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400438.669380:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400438.669474:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:2362:x1873176368790784:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 7161us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400438.669484:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:1.0:1786400438.674994:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392945536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400438.675070:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400438.675160:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392945536 00000100:00100000:2.0:1786400438.675168:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392945536 00000100:00100000:2.0:1786400438.675232:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786400438.675242:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392945536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400438.675277:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400438.675321:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392945536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400438.675329:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1786400438.675368:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c3480 x1873176392945536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400438.675387:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392945536:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786400439.442952:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400440.229003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400440.229044:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368790912 00000100:00100000:1.0:1786400440.229053:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368790912 00000100:00100000:1.0:1786400440.229103:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 234 00000100:00100000:1.0:1786400440.229113:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:5580:x1873176368790912:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400440.229131:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400440.229152:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f504f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.229191:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.229218:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.229228:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe200, rc 0) 00000100:00100000:1.0:1786400440.229292:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368790912:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 181us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400440.229299:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 234 00000100:00100000:1.0:1786400440.232046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400440.232114:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368791040 00000100:00100000:2.0:1786400440.232123:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368791040 00000100:00100000:2.0:1786400440.232174:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 235 00000100:00100000:2.0:1786400440.232306:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368791040:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400440.232801:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368791040:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 617us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400440.232810:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 235 00000100:00100000:1.0:1786400440.248625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400440.251437:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368791168 00000100:00100000:0.0:1786400440.251454:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368791168 00000100:00100000:0.0:1786400440.251514:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 236 00000100:00100000:0.0:1786400440.251525:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368791168:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.251801:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368791168:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 277us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400440.251809:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 236 00000100:00100000:1.0:1786400440.264040:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400440.264090:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368791296 00000100:00100000:1.0:1786400440.264102:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368791296 00000100:00100000:1.0:1786400440.264156:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 237 00000100:00100000:1.0:1786400440.264166:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368791296:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400440.264197:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400440.264223:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5056 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.264269:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.264282:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.264293:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebfe00, rc 0) 00000100:00100000:1.0:1786400440.264348:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368791296:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 183us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400440.264373:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 237 00000100:00100000:1.0:1786400440.280371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400440.280631:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368791424 00000100:00100000:2.0:1786400440.280656:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368791424 00000100:00100000:2.0:1786400440.280766:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 238 00000100:00100000:2.0:1786400440.280777:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368791424:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400440.281067:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368791424:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 290us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400440.281076:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 238 00000100:00100000:1.0:1786400440.285004:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400440.286805:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368791552 00000100:00100000:0.0:1786400440.286818:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368791552 00000100:00100000:0.0:1786400440.286872:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 239 00000100:00100000:0.0:1786400440.286882:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368791552:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.287112:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368791552:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 230us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400440.287122:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 239 10000000:01000000:1.0:1786400440.403199:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786400440.403208:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373bf25e800 from 7 10000000:01000000:1.0:1786400440.403213:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786400440.403275:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.403289:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.403302:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400440.403336:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392945664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400440.403447:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400440.403502:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400440.403527:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392945664 00000100:00100000:1.0:1786400440.403536:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392945664 00000100:00100000:1.0:1786400440.403589:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1786400440.403600:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392945664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400440.403614:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400440.403628:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a51f0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.403653:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.403677:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400440.403687:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe800, rc 0) 00000100:00100000:1.0:1786400440.403769:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392945664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400440.403776:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1786400440.404033:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392945664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400440.404051:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.404061:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400440.404120:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392945792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400440.418546:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400440.418626:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400440.418671:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392945792 00000100:00100000:2.0:1786400440.418680:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392945792 00000100:00100000:2.0:1786400440.418910:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1786400440.418923:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392945792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400440.419233:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392945792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400440.419242:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1786400440.419330:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392945792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400440.419388:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392945920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400440.419450:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400440.419688:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9c37480 going to sleep for 11 seconds 00000100:00100000:1.0:1786400440.419999:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392945920 00000100:00100000:1.0:1786400440.420005:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392945920 00000100:00100000:1.0:1786400440.420036:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1786400440.420044:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392945920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400440.420232:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392945920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400440.420239:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1786400440.420327:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392945920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786400440.421241:0:11095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1786400440.424032:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1786400440.424063:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786400440.424075:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.424089:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400440.424100:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786400440.424103:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373b7b4b000 from 7 10000000:01000000:0.0:1786400440.424106:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400440.424150:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.424159:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.424185:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400440.424210:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.424275:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400440.424316:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392946048 00000100:00100000:0.0:1786400440.424323:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392946048 00000100:00100000:0.0:1786400440.424369:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1786400440.424568:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392946048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400440.424584:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400440.424596:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a51fe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.424619:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.424631:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.424641:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:0.0:1786400440.424677:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392946048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400440.424686:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1786400440.424827:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373911689c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400440.424852:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400440.424868:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.424883:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400440.424935:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.424959:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400440.424987:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400440.425009:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392946176 00000100:00100000:2.0:1786400440.425015:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392946176 00000100:00100000:2.0:1786400440.425049:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1786400440.425057:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392946176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400440.425317:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392946176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400440.425324:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1786400440.425354:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.427423:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.427518:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400440.427573:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400440.427586:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392946304 00000100:00100000:2.0:1786400440.427595:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392946304 00000100:00100000:2.0:1786400440.427649:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1786400440.427659:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392946304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400440.429130:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392946304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1467us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400440.429153:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1786400440.429417:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786400440.438340:0:11098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1786400440.441872:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1786400440.441909:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786400440.441922:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.442214:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400440.442227:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786400440.442231:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373910fb800 from 7 10000000:01000000:0.0:1786400440.442234:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400440.442278:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.442301:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.442313:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400440.442342:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.442437:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400440.442489:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc6780 going to sleep for 11 seconds 00000100:00100000:2.0:1786400440.442647:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392946432 00000100:00100000:2.0:1786400440.442656:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392946432 00000100:00100000:2.0:1786400440.442707:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1786400440.442716:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392946432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400440.442731:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400440.442779:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a520c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400440.442802:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a520c expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400440.442812:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a520c expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400440.442820:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e000, rc 0) 00000100:00100000:2.0:1786400440.442861:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392946432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400440.442869:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1786400440.443128:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400440.443142:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400440.443150:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400440.443201:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.443226:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400440.443249:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392946560 00000100:00100000:0.0:1786400440.443252:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392946560 00000100:00100000:0.0:1786400440.443275:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1786400440.443281:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392946560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.445594:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392946560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2306us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400440.445608:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1786400440.445671:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc6780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400440.445708:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.446230:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400440.446282:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400440.446312:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400440.446605:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392946688 00000100:00100000:2.0:1786400440.446613:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392946688 00000100:00100000:2.0:1786400440.446672:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1786400440.446682:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392946688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400440.446920:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392946688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400440.446927:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1786400440.447859:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392946688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786400440.452085:0:11099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786400440.452371:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786400440.452413:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400440.452433:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400440.452446:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400440.475181:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400441.502013:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400442.263189:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392946816:0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263281:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400442.263333:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392947328:0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263360:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400442.263400:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400442.263407:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392947200:0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263432:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400442.263461:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392946944:0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263483:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400442.263510:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392947456:0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263530:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400442.263548:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400442.263554:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392947072:0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263573:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400442.263605:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392947328 00000100:00100000:1.0:1786400442.263613:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392947328 00000100:00100000:1.0:1786400442.263667:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392946944 00000100:00100000:1.0:1786400442.263670:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392946944 00000100:00100000:1.0:1786400442.263686:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392947072 00000100:00100000:1.0:1786400442.263689:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392947072 00000100:00100000:1.0:1786400442.263706:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786400442.263715:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392947328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263789:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392947328:12345-0@lo:400:kworker.0 Request processed in 74us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400442.263796:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786400442.263813:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786400442.263819:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392946944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263851:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392946944:12345-0@lo:400:kworker.0 Request processed in 32us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400442.263857:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786400442.263868:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786400442.263874:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392947072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.263900:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392947072:12345-0@lo:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400442.263906:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786400442.263926:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392947200 00000100:00100000:1.0:1786400442.263936:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392947200 00000100:00100000:1.0:1786400442.263963:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392947456 00000100:00100000:1.0:1786400442.263966:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392947456 00000100:00100000:1.0:1786400442.263983:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786400442.263988:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392947200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.264019:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392947200:12345-0@lo:400:kworker.0 Request processed in 31us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400442.264024:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786400442.264036:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786400442.264042:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392947456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.264068:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392947456:12345-0@lo:400:kworker.0 Request processed in 26us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400442.264074:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1786400442.264098:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400442.264102:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400442.264105:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400442.264142:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392947072:0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.264154:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392946944:0@lo:400:kworker.0 00010000:00080000:1.0:1786400442.264164:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c0a80 x1873176392947456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400442.264175:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392947456:0@lo:400:kworker.0 00010000:00080000:1.0:1786400442.264208:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c1f80 x1873176392947200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400442.264217:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392947200:0@lo:400:kworker.0 00000100:00100000:1.0:1786400442.264226:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392947328:0@lo:400:kworker.0 00000100:00100000:2.0:1786400442.264487:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392946816 00000100:00100000:2.0:1786400442.264492:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392946816 00000100:00100000:2.0:1786400442.264534:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1786400442.264542:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392946816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400442.264583:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392946816:12345-0@lo:400:kworker.0 Request processed in 42us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400442.264589:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1786400442.264732:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392946816:0@lo:400:kworker.0 00010000:00010000:1.0:1786400442.521076:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400442.773956:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392947584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400442.774058:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400442.774154:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392947584 00000100:00100000:2.0:1786400442.774164:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392947584 00000100:00100000:2.0:1786400442.774219:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786400442.774228:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392947584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400442.774267:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400442.774312:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392947584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400442.774320:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1786400442.774364:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c0000 x1873176392947584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400442.774702:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392947584:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400443.543567:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400443.680063:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400443.680114:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400443.680148:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400443.680187:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368791808 00000100:00100000:3.0:1786400443.680210:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368791808 00000100:00100000:3.0:1786400443.680271:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368791936 00000100:00100000:3.0:1786400443.680275:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368791936 00000100:00100000:3.0:1786400443.680298:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:3.0:1786400443.680308:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368791808:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400443.680416:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368791808:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 109us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400443.680425:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:3.0:1786400443.680449:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 104 00000100:00100000:3.0:1786400443.680456:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368791936:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400443.680484:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368791936:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400443.680491:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 104 00000100:00080000:3.0:1786400443.680508:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400443.681175:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368791680 00000100:00100000:2.0:1786400443.681182:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368791680 00000100:00100000:2.0:1786400443.681231:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 250 00000100:00100000:2.0:1786400443.681238:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368791680:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400443.681285:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368791680:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 47us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400443.681292:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 250 00000100:00100000:2.0:1786400443.797077:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400443.797101:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392947712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400443.797174:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400443.797236:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392947712 00000100:00100000:2.0:1786400443.797245:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392947712 00000100:00100000:2.0:1786400443.797293:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786400443.797303:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392947712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400443.797338:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400443.797401:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392947712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400443.797408:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1786400443.797450:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c0000 x1873176392947712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400443.797469:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392947712:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1786400444.189853:0:11260:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1786400444.563399:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400445.587779:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400446.632894:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400447.379162:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392948224:0@lo:400:kworker.0 00000100:00100000:0.0:1786400447.379162:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392948096:0@lo:400:kworker.0 00000100:00100000:1.0:1786400447.379243:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392947968:0@lo:400:kworker.0 00000100:00100000:2.0:1786400447.379291:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392947840:0@lo:400:kworker.0 00000100:00100000:0.0:1786400447.386555:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400447.386676:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392948096 00000100:00100000:0.0:1786400447.386685:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392948096 00000100:00100000:3.0:1786400447.386696:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400447.386762:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1786400447.386775:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392948096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400447.386842:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392948096:12345-0@lo:400:kworker.0 Request processed in 70us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400447.386850:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1786400447.386863:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400447.386882:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392948224 00000100:00100000:3.0:1786400447.386885:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392948224 00000100:00100000:0.0:1786400447.386892:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392948096:0@lo:400:kworker.0 00000100:00100000:3.0:1786400447.386918:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786400447.386925:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392948224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400447.386984:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392948224:12345-0@lo:400:kworker.0 Request processed in 59us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400447.386990:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1786400447.387006:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786400447.387090:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3ad80 x1873176392948224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400447.387102:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392948224:0@lo:400:kworker.0 00000100:00100000:1.0:1786400447.398933:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400447.399017:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392948480:0@lo:400:kworker.0 00000100:00100000:1.0:1786400447.399060:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400447.399193:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392947968 00000100:00100000:3.0:1786400447.399203:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392947968 00000100:00100000:3.0:1786400447.399282:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786400447.399292:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392947968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400447.399366:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392947968:12345-0@lo:400:kworker.0 Request processed in 75us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400447.399374:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786400447.399419:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392947968:0@lo:400:kworker.0 00000100:00100000:0.0:1786400447.400030:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392948480 00000100:00100000:0.0:1786400447.400037:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392948480 00000100:00100000:0.0:1786400447.400090:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786400447.400107:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392948480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400447.400175:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392948480:12345-0@lo:400:kworker.0 Request processed in 70us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400447.400181:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786400447.400317:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400447.400366:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392948352:0@lo:400:kworker.0 00000100:00100000:2.0:1786400447.400393:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400447.400433:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392948352 00000100:00100000:2.0:1786400447.400437:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392948352 00000100:00100000:2.0:1786400447.400468:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1786400447.400475:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392948352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400447.400510:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392948352:12345-0@lo:400:kworker.0 Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400447.400517:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1786400447.400548:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392948352:0@lo:400:kworker.0 00000100:00080000:3.0:1786400447.400819:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786400447.400824:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1786400447.400850:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e3b100 x1873176392948480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400447.400861:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392948480:0@lo:400:kworker.0 00000100:00100000:0.0:1786400447.400937:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392947840 00000100:00100000:0.0:1786400447.400942:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392947840 00000100:00100000:0.0:1786400447.400969:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1786400447.400975:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392947840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400447.401026:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392947840:12345-0@lo:400:kworker.0 Request processed in 50us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400447.401034:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1786400447.401164:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392947840:0@lo:400:kworker.0 00010000:00010000:0.0:1786400447.637692:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400447.891578:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392948608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400447.891668:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400447.892068:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392948608 00000100:00100000:0.0:1786400447.892078:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392948608 00000100:00100000:0.0:1786400447.892145:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786400447.892155:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392948608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400447.892195:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400447.892251:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392948608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400447.892258:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1786400447.892308:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75ae300 x1873176392948608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400447.892328:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392948608:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1786400448.413684:0:11359:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:20:46 (1786400446) === 00010000:00010000:1.0:1786400448.658955:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400448.719829:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400448.719879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400448.719979:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368792064 00000100:00100000:2.0:1786400448.719989:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368792064 00000100:00100000:2.0:1786400448.720068:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1786400448.720078:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368792064:12345-192.168.201.23@tcp:41:mkdir.0 00000004:00000024:2.0:1786400448.720129:0:5817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786400448.720218:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368792064:12345-192.168.201.23@tcp:41:mkdir.0 Request processed in 141us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400448.720227:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00080000:1.0:1786400448.720409:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400448.724993:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368792192 00000100:00100000:1.0:1786400448.725008:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368792192 00000100:00100000:1.0:1786400448.725074:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1786400448.725083:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:9672:x1873176368792192:12345-192.168.201.23@tcp:700:mkdir.0 00000100:00100000:1.0:1786400448.725181:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:9672:x1873176368792192:12345-192.168.201.23@tcp:700:mkdir.0 Request processed in 99us (5301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400448.725189:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1786400448.739558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400448.740478:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368792448 00000100:00100000:2.0:1786400448.740489:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368792448 00000100:00100000:2.0:1786400448.740539:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:2.0:1786400448.740548:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:9672:x1873176368792448:12345-192.168.201.23@tcp:36:mkdir.0 00010000:00010000:2.0:1786400448.740604:0:8098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400448.740659:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c21fc200/0x49554f35ff0a50fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fd8 expref: 6 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.740692:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400448.740704:0:8098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400448.741018:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.741032:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.741042:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.741070:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.741078:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.741085:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400448.742277:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1786400448.742303:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.742312:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.742320:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.742326:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400448.742337:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.742345:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.742358:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937386801b00) 00010000:00010000:2.0:1786400448.742362:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400448.742366:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.742372:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a521a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400448.742389:0:8098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c3ed8e5 reply state 0000000064965cc4 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400448.742399:0:8098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400448.742499:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:9672:x1873176368792448:12345-192.168.201.23@tcp:36:mkdir.0 Request processed in 1949us (2948us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1786400448.742508:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00010000:00010000:1.0:1786400448.750153:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.750170:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.750208:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.750215:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ec00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400448.750220:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.750228:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.750249:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff937386801f00) 00010000:00010000:1.0:1786400448.750253:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400448.750257:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.750263:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5221 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400448.767510:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400448.767663:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368792576 00000100:00100000:2.0:1786400448.767674:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368792576 00000100:00100000:2.0:1786400448.767773:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:2.0:1786400448.767785:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:9673:x1873176368792576:12345-192.168.201.23@tcp:101:chmod.0 00010000:00010000:2.0:1786400448.767808:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400448.767830:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f505d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.767893:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a522f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.767913:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a522f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.767924:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a522f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400448.767988:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1786400448.767992:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400448.768048:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a522f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.768075:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f505d expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.768091:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a522f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f505d expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.768099:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937386801b00) 00010000:00010000:2.0:1786400448.768101:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786400448.768105:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1ec00, rc 0) 00000100:00100000:2.0:1786400448.768168:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:9673:x1873176368792576:12345-192.168.201.23@tcp:101:chmod.0 Request processed in 385us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400448.768175:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:2.0:1786400448.780173:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400448.780252:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368792832 00000100:00100000:0.0:1786400448.780261:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368792832 00000100:00100000:0.0:1786400448.780348:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1786400448.780380:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:9673:x1873176368792832:12345-192.168.201.23@tcp:36:chmod.0 00010000:00010000:0.0:1786400448.780430:0:8098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400448.780459:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a522f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f505d expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.780477:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937386801b00) 00010000:00010000:0.0:1786400448.780489:0:8098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400448.780512:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.780524:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.780533:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400448.780899:0:8098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004af5b13c reply state 000000003f74f4b4 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400448.780909:0:8098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1786400448.780921:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1786400448.781015:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:9673:x1873176368792832:12345-192.168.201.23@tcp:36:chmod.0 Request processed in 643us (850us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1786400448.781022:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00010000:00010000:2.0:1786400448.782781:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.782796:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.782816:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.782823:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400448.782827:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.782834:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.782850:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:2.0:1786400448.782853:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786400448.782857:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400448.782864:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5236 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400448.801502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400448.801595:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400448.801690:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368793088 00000100:00100000:0.0:1786400448.801699:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368793088 00000100:00100000:0.0:1786400448.801806:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 108 00000100:00100000:0.0:1786400448.801816:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368793088:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400448.801894:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368793088:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400448.801916:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 108 00000100:00080000:1.0:1786400448.801991:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400448.802268:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368792960 00000100:00100000:3.0:1786400448.802273:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368792960 00000100:00100000:3.0:1786400448.802322:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 252 00000100:00100000:3.0:1786400448.802330:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368792960:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400448.802533:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368792960:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 202us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400448.802542:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 252 00000100:00100000:2.0:1786400448.851488:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400448.851659:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368793216 00000100:00100000:0.0:1786400448.851670:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368793216 00000100:00100000:0.0:1786400448.851770:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1786400448.851783:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:9674:x1873176368793216:12345-192.168.201.23@tcp:101:chown.0 00010000:00010000:0.0:1786400448.851808:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400448.851833:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a523d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5064 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.851903:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5244 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.851916:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.851927:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400448.851986:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786400448.851990:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400448.852056:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.852084:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a523d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5064 expref: 9 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.852103:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5064 expref: 8 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.852124:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128dd00) 00010000:00010000:0.0:1786400448.852127:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400448.852131:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031e00, rc 0) 00000100:00100000:0.0:1786400448.852185:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:9674:x1873176368793216:12345-192.168.201.23@tcp:101:chown.0 Request processed in 405us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400448.852192:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1786400448.864850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400448.865352:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368793344 00000100:00100000:0.0:1786400448.865363:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368793344 00000100:00100000:0.0:1786400448.865437:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:0.0:1786400448.865448:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:9674:x1873176368793344:12345-192.168.201.23@tcp:101:chown.0 00010000:00010000:0.0:1786400448.865470:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400448.865491:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a524b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f506b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865553:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865567:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865579:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865595:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865602:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865627:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865726:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2177e00/0x49554f35ff0a5260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865734:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2177e00/0x49554f35ff0a5260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865784:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2177e00/0x49554f35ff0a5260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400448.865825:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1786400448.865829:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400448.865855:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2177e00/0x49554f35ff0a5260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865868:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865874:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865880:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865886:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400448.865891:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865898:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865918:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128dd00) 00010000:00010000:0.0:1786400448.865921:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400448.865926:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865931:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865948:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865954:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865961:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865966:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c2176000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400448.865969:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865976:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865983:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93739128d400) 00010000:00010000:0.0:1786400448.865986:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400448.865988:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.865994:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5259 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.866038:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a524b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f506b expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.866052:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2177e00/0x49554f35ff0a5260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f506b expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.866060:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93739128d900) 00010000:00010000:0.0:1786400448.866062:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400448.866065:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c2177e00, rc 0) 00000100:00100000:0.0:1786400448.866127:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:9674:x1873176368793344:12345-192.168.201.23@tcp:101:chown.0 Request processed in 681us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400448.866134:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:2.0:1786400448.872684:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400448.873271:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368793600 00000100:00100000:0.0:1786400448.873302:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368793600 00000100:00100000:0.0:1786400448.873361:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:0.0:1786400448.873384:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:9674:x1873176368793600:12345-192.168.201.23@tcp:36:chown.0 00010000:00010000:0.0:1786400448.873447:0:8098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400448.873477:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2177e00/0x49554f35ff0a5260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f506b expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.873503:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93739128d900) 00010000:00010000:0.0:1786400448.873515:0:8098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400448.873544:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.873557:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400448.873582:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400448.915940:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400448.915964:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392948736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400448.916039:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400448.916165:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392948736 00000100:00100000:2.0:1786400448.916174:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392948736 00000100:00100000:2.0:1786400448.916234:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786400448.916244:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392948736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400448.916292:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400448.916343:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392948736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400448.916366:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1786400448.916603:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c3480 x1873176392948736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400448.916636:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392948736:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1786400448.957839:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1786400448.957929:0:8098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e956d67 reply state 00000000518841cf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400448.957945:0:8098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1786400448.958116:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1786400448.958222:0:8098:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1786400448.958243:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:9674:x1873176368793600:12345-192.168.201.23@tcp:36:chown.0 Request processed in 84868us (85567us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1786400448.958253:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00010000:00010000:1.0:1786400448.958533:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.958542:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.958549:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.958568:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c2176400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400448.958573:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.958581:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.958599:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93739128d300) 00010000:00010000:1.0:1786400448.958601:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786400448.958606:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400448.958612:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a5267 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400448.986870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400448.987042:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368793728 00000100:00100000:0.0:1786400448.987053:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368793728 00000100:00100000:0.0:1786400448.987112:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:0.0:1786400448.987122:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:9675:x1873176368793728:12345-192.168.201.23@tcp:101:touch.500 00010000:00010000:0.0:1786400448.987150:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400448.987171:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2177e00/0x49554f35ff0a526e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5072 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400448.988370:0:5817:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1149us 00010000:00010000:2.0:1786400449.019333:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.019355:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.019367:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.019386:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.019394:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.019400:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.019915:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.019925:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.019932:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400449.020010:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786400449.020014:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400449.020103:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020122:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020128:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020135:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020140:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400449.020144:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020151:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020163:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128dd00) 00010000:00010000:2.0:1786400449.020166:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400449.020170:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020176:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5275 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020186:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020192:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020197:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020207:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400449.020210:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020216:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020225:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff937386801700) 00010000:00010000:2.0:1786400449.020227:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400449.020230:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020235:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a527c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020276:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2177e00/0x49554f35ff0a526e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5072 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020307:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5072 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.020314:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400449.020316:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786400449.020319:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fe00, rc 0) 00000100:00100000:2.0:1786400449.020405:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:9675:x1873176368793728:12345-192.168.201.23@tcp:101:touch.500 Request processed in 33281us (33541us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400449.020416:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1786400449.033396:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400449.033518:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368793984 00000100:00100000:2.0:1786400449.033543:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368793984 00000100:00100000:2.0:1786400449.033617:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:2.0:1786400449.033627:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:9675:x1873176368793984:12345-192.168.201.23@tcp:101:touch.500 00010000:00010000:2.0:1786400449.033649:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400449.033668:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a528a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5079 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.034026:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.034040:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.034050:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.034097:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.034105:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.034111:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400449.035146:0:5818:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1786400449.035685:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a529f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035699:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a529f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035720:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a529f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035938:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035946:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035953:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035959:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400449.035963:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035969:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035982:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400449.035984:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400449.035988:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.035994:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5291 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400449.036007:0:5818:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006bd6a0df reply state 000000007e5cb81b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400449.036016:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786400449.036059:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a528a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5079 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.036075:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a529f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5079 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.036082:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff937386801f00) 00010000:00010000:2.0:1786400449.036085:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400449.036087:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e800, rc 0) 00000100:00100000:2.0:1786400449.036348:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:9675:x1873176368793984:12345-192.168.201.23@tcp:101:touch.500 Request processed in 2722us (2960us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1786400449.036357:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:3.0:1786400449.045626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:1.0:1786400449.045797:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.045811:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.045820:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.045826:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400449.045831:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.045864:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.045886:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff937386801b00) 00010000:00010000:1.0:1786400449.045889:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400449.045894:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.045901:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f600/0x49554f35ff0a5298 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400449.046097:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368794240 00000100:00100000:2.0:1786400449.046107:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368794240 00000100:00100000:2.0:1786400449.046168:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:2.0:1786400449.046178:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:9675:x1873176368794240:12345-192.168.201.23@tcp:36:touch.500 00010000:00010000:2.0:1786400449.046246:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400449.046263:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a529f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5079 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.046274:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff937386801f00) 00010000:00010000:2.0:1786400449.046291:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400449.046333:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.046346:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.046356:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400449.046496:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021c10382 reply state 00000000fb5bf0b9 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400449.046506:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400449.046929:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:9675:x1873176368794240:12345-192.168.201.23@tcp:36:touch.500 Request processed in 419us (980us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1786400449.046938:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00010000:00010000:2.0:1786400449.049915:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.049933:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.049940:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.049946:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400449.049951:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.049959:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.049975:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400449.049978:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400449.049984:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.049989:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400449.052251:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400449.052605:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368794368 00000100:00100000:0.0:1786400449.052616:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368794368 00000100:00100000:0.0:1786400449.052675:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:0.0:1786400449.052685:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:9675:x1873176368794368:12345-192.168.201.23@tcp:101:touch.500 00010000:00010000:0.0:1786400449.052709:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400449.052733:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a52b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5080 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400449.052847:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a52b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5080 expref: 10 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400449.052863:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a52b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5080 expref: 10 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400449.052883:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93739128d900) 00010000:00010000:0.0:1786400449.052899:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400449.052903:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c2176000, rc 0) 00000100:00100000:0.0:1786400449.052958:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:9675:x1873176368794368:12345-192.168.201.23@tcp:101:touch.500 Request processed in 274us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400449.052965:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:3.0:1786400449.058557:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400449.059346:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368794496 00000100:00100000:0.0:1786400449.059360:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368794496 00000100:00100000:0.0:1786400449.059415:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:0.0:1786400449.059424:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873176368794496:12345-192.168.201.23@tcp:8:touch.500 00010000:00080000:0.0:1786400449.059455:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:0.0:1786400449.059488:0:6622:0:(genops.c:1406:class_connect()) connect: client 2e546c9b-fa03-4565-a5c8-6992a70a28db, cookie 0x49554f35ff0a52bb 00002000:00100000:0.0:1786400449.059501:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e546c9b-fa03-4565-a5c8-6992a70a28db/ffff9373b890e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786400449.059512:0:6622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786400449.060102:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786400449.060135:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9373b890c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400449.060203:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2358:x1873176368794496:12345-192.168.201.23@tcp:8:touch.500 Request processed in 778us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400449.060211:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:3.0:1786400449.067381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400449.067555:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368794624 00000100:00100000:0.0:1786400449.067567:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368794624 00000100:00100000:0.0:1786400449.067661:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1786400449.067681:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:0:x1873176368794624:12345-192.168.201.23@tcp:2:touch.500 00000100:00080000:1.0:1786400449.069131:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1786400449.197541:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1786400449.197558:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000100:00100000:3.0:1786400449.200210:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:0:x1873176368794624:12345-192.168.201.23@tcp:2:touch.500 Request processed in 132527us (132826us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1786400449.200237:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:1.0:1786400449.204478:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400449.204579:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368794880 00000100:00100000:2.0:1786400449.204590:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368794880 00000100:00100000:2.0:1786400449.204662:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:2.0:1786400449.204675:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:9675:x1873176368794880:12345-192.168.201.23@tcp:35:touch.500 00000100:00100000:2.0:1786400449.205065:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+11:9675:x1873176368794880:12345-192.168.201.23@tcp:35:touch.500 Request processed in 390us (594us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1786400449.205073:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1786400449.225144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400449.225439:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368795008 00000100:00100000:2.0:1786400449.225451:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368795008 00000100:00100000:2.0:1786400449.225527:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:2.0:1786400449.225538:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+11:9676:x1873176368795008:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1786400449.225565:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400449.225587:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5087 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.225661:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a52c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.225675:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a52c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.225687:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a52c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400449.226974:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786400449.226982:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400449.227048:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a52c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.227086:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a52c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5087 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.227107:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a52c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5087 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.227137:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400449.227140:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400449.227145:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e800, rc 0) 00000100:00100000:3.0:1786400449.227447:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:9676:x1873176368795008:12345-192.168.201.23@tcp:101:rm.0 Request processed in 1909us (2310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400449.227456:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:0.0:1786400449.245074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400449.245195:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368795264 00000100:00100000:3.0:1786400449.245208:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368795264 00000100:00100000:3.0:1786400449.245300:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:3.0:1786400449.245311:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:9676:x1873176368795264:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:3.0:1786400449.245341:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400449.245364:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a52d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f508e expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400449.245485:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1786400449.245621:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a52d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f508e expref: 14 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.245636:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128dd00) 00010000:00010000:3.0:1786400449.245639:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400449.245644:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a52d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f508e expref: 14 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.245660:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763400, rc 0) 00000100:00100000:3.0:1786400449.245723:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:9676:x1873176368795264:12345-192.168.201.23@tcp:101:rm.0 Request processed in 414us (662us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1786400449.245803:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:0.0:1786400449.252510:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400449.252630:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368795392 00000100:00100000:2.0:1786400449.252643:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368795392 00000100:00100000:2.0:1786400449.252712:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1786400449.252723:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:9676:x1873176368795392:12345-192.168.201.23@tcp:37:rm.0 00000100:00100000:2.0:1786400449.267296:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:9676:x1873176368795392:12345-192.168.201.23@tcp:37:rm.0 Request processed in 14553us (14774us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400449.267311:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:3.0:1786400449.286886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400449.287197:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368795648 00000100:00100000:0.0:1786400449.287209:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368795648 00000100:00100000:0.0:1786400449.287292:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:0.0:1786400449.287302:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739026a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:9676:x1873176368795648:12345-192.168.201.23@tcp:35:rm.0 00000100:00100000:0.0:1786400449.287572:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739026a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:9676:x1873176368795648:12345-192.168.201.23@tcp:35:rm.0 Request processed in 271us (698us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1786400449.287581:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:0.0:1786400449.290306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400449.290449:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368795904 00000100:00100000:1.0:1786400449.290459:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368795904 00000100:00100000:1.0:1786400449.290517:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:1.0:1786400449.290528:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:9676:x1873176368795904:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:1.0:1786400449.290551:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400449.290572:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a52de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5095 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.290702:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a52e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.290717:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a52e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.290731:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a52e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400449.290783:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1786400449.290927:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a52de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5095 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.290946:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a52e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5095 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.290954:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff937386801600) 00010000:00010000:1.0:1786400449.290957:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786400449.290960:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf800, rc 0) 00000100:00100000:1.0:1786400449.291030:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:9676:x1873176368795904:12345-192.168.201.23@tcp:101:rm.0 Request processed in 504us (733us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1786400449.291038:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:1.0:1786400449.295286:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400449.295367:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368796032 00000100:00100000:3.0:1786400449.295377:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368796032 00000100:00100000:3.0:1786400449.295436:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:3.0:1786400449.295446:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:9676:x1873176368796032:12345-192.168.201.23@tcp:41:rm.0 00000004:00000024:3.0:1786400449.295514:0:8098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1786400449.295582:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:9676:x1873176368796032:12345-192.168.201.23@tcp:41:rm.0 Request processed in 138us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400449.295590:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:0.0:1786400449.298063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400449.298212:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368796160 00000100:00100000:1.0:1786400449.298222:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368796160 00000100:00100000:1.0:1786400449.298320:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:1.0:1786400449.298332:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:9676:x1873176368796160:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:1.0:1786400449.298354:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400449.298376:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a52f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f509c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298441:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298457:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298488:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298505:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298513:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298519:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298636:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298644:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298651:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400449.298679:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1786400449.298684:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400449.298701:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298712:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298720:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298736:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298774:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298789:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400449.298794:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298802:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298814:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff937386801600) 00010000:00010000:1.0:1786400449.298817:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400449.298822:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298828:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a52fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298842:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298848:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298853:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298858:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400449.298867:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298874:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298882:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9373850bf800) 00010000:00010000:1.0:1786400449.298884:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400449.298887:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298893:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a5301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298925:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a52f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f509c expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298937:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f509c expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.298943:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93739128d900) 00010000:00010000:1.0:1786400449.298945:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400449.298948:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe400, rc 0) 00000100:00100000:1.0:1786400449.299021:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:9676:x1873176368796160:12345-192.168.201.23@tcp:101:rm.0 Request processed in 691us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400449.299029:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:0.0:1786400449.304012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400449.304165:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368796416 00000100:00100000:3.0:1786400449.304178:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368796416 00000100:00100000:3.0:1786400449.304257:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:3.0:1786400449.304269:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:9676:x1873176368796416:12345-192.168.201.23@tcp:36:rm.0 00010000:00010000:3.0:1786400449.304339:0:8098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1786400449.304369:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f509c expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304393:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a52b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5080 expref: 16 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304408:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93739128d900) 00010000:00010000:3.0:1786400449.304425:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a52c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5087 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304433:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400449.304450:0:8098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400449.304474:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304487:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304498:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304512:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304519:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304526:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304656:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304666:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.304673:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786400449.308428:0:8098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1786400449.308448:0:8098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371049708488ns, next at 372049704626ns, rc = 0 00010000:00010000:3.0:1786400449.308538:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308571:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308583:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308592:0:8098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308599:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308605:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308631:0:8098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786400449.308654:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308660:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308667:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308673:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400449.308677:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308685:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308708:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9373a3445f00) 00010000:00010000:3.0:1786400449.308711:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786400449.308716:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308722:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762200/0x49554f35ff0a531d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308775:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308793:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308799:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308804:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400449.308807:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308813:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308821:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400449.308824:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400449.308827:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400449.308832:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a530f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786400449.308854:0:8098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003cb781a7 reply state 00000000a7ac9da0 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400449.308863:0:8098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786400449.308961:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:9676:x1873176368796416:12345-192.168.201.23@tcp:36:rm.0 Request processed in 4691us (4957us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1786400449.308972:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 30 00010000:00010000:2.0:1786400449.309660:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400449.309669:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.309677:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762600 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400449.309681:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.309688:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.309701:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9373a3445f00) 00010000:00010000:2.0:1786400449.309704:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786400449.309776:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.309791:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5324 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.309809:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400449.309811:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400449.309812:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400449.318495:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.318514:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.318535:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.318542:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400449.318546:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.318553:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.318570:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9373a3445500) 00010000:00010000:1.0:1786400449.318574:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400449.318579:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.318584:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5316 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400449.319447:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400449.319531:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368796672 00000100:00100000:3.0:1786400449.319541:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368796672 00000100:00100000:3.0:1786400449.319604:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:3.0:1786400449.319613:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:9676:x1873176368796672:12345-192.168.201.23@tcp:35:rm.0 00000100:00100000:3.0:1786400449.319916:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:9676:x1873176368796672:12345-192.168.201.23@tcp:35:rm.0 Request processed in 303us (475us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1786400449.319925:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:2.0:1786400449.322982:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400449.323081:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368796928 00000100:00100000:1.0:1786400449.323090:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368796928 00000100:00100000:1.0:1786400449.323142:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:1.0:1786400449.323150:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:9676:x1873176368796928:12345-192.168.201.23@tcp:36:rm.0 00010000:00010000:1.0:1786400449.323205:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786400449.323242:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a52e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5095 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323264:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5072 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323303:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff937386801600) 00010000:00010000:1.0:1786400449.323319:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5244 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5064 expref: 14 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323329:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128dd00) 00010000:00010000:1.0:1786400449.323335:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400449.323359:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323371:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323381:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323393:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323401:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323407:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323690:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323699:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.323716:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400449.324319:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1786400449.324337:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324345:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324351:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324357:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebec00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400449.324362:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324369:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324380:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:1.0:1786400449.324383:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786400449.324388:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324394:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebec00/0x49554f35ff0a5339 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324417:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324424:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324435:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324441:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400449.324444:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324449:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324457:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf800) 00010000:00010000:1.0:1786400449.324460:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400449.324463:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.324469:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe000/0x49554f35ff0a532b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400449.324480:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000777cd238 reply state 0000000070b445ab transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400449.324488:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400449.324567:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:9676:x1873176368796928:12345-192.168.201.23@tcp:36:rm.0 Request processed in 1414us (1590us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1786400449.324576:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00010000:00010000:2.0:1786400449.328772:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.328790:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.328813:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.328819:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400449.328824:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.328832:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.328848:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9373850bff00) 00010000:00010000:2.0:1786400449.328851:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400449.328855:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400449.328861:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf200/0x49554f35ff0a5332 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400449.685528:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400450.709563:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400451.732484:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400452.506820:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392948992:0@lo:400:kworker.0 00000100:00100000:3.0:1786400452.506894:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400452.506945:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392949504:0@lo:400:kworker.0 00000100:00100000:3.0:1786400452.506973:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400452.507004:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400452.507010:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392949120:0@lo:400:kworker.0 00000100:00100000:3.0:1786400452.507029:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400452.507058:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392948992 00000100:00100000:3.0:1786400452.507065:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392948992 00000100:00100000:3.0:1786400452.507106:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392949120 00000100:00100000:3.0:1786400452.507109:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392949120 00000100:00100000:3.0:1786400452.507146:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1786400452.507167:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392948992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400452.507228:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392948992:12345-0@lo:400:kworker.0 Request processed in 51us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400452.507237:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1786400452.507254:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786400452.507260:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392949120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400452.507285:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392949120:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400452.507291:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786400452.507310:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392949504 00000100:00100000:3.0:1786400452.507313:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392949504 00000100:00100000:3.0:1786400452.507558:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786400452.507565:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392949504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400452.507597:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392949504:12345-0@lo:400:kworker.0 Request processed in 33us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400452.507603:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786400452.507650:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392949120:0@lo:400:kworker.0 00000100:00100000:3.0:1786400452.507660:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392948992:0@lo:400:kworker.0 00010000:00080000:3.0:1786400452.507671:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391174e00 x1873176392949504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400452.507682:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392949504:0@lo:400:kworker.0 00000100:00100000:0.0:1786400452.507788:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373a0c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392948864:0@lo:400:kworker.0 00000100:00100000:0.0:1786400452.507823:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400452.507853:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392949376:0@lo:400:kworker.0 00000100:00100000:0.0:1786400452.507874:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400452.507891:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400452.507896:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392949248:0@lo:400:kworker.0 00000100:00100000:0.0:1786400452.507914:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400452.507941:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392949248 00000100:00100000:0.0:1786400452.507944:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392949248 00000100:00100000:0.0:1786400452.507974:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786400452.507981:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392949248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400452.508015:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392949248:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400452.508022:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1786400452.508062:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937391176a00 x1873176392949248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400452.508071:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392949248:0@lo:400:kworker.0 00000100:00100000:0.0:1786400452.508087:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392949376 00000100:00100000:0.0:1786400452.508090:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392949376 00000100:00100000:0.0:1786400452.508116:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786400452.508122:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392949376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400452.508155:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392949376:12345-0@lo:400:kworker.0 Request processed in 34us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400452.508161:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786400452.508184:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392949376:0@lo:400:kworker.0 00000100:00080000:1.0:1786400452.508350:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400452.508363:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400452.508366:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400452.508717:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392948864 00000100:00100000:3.0:1786400452.508724:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392948864 00000100:00100000:3.0:1786400452.508781:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1786400452.508788:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392948864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400452.508835:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392948864:12345-0@lo:400:kworker.0 Request processed in 47us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400452.508842:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1786400452.511306:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373a0c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392948864:0@lo:400:kworker.0 00010000:00010000:2.0:1786400452.756040:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400453.011168:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400453.011195:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392949632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400453.011298:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400453.011595:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392949632 00000100:00100000:0.0:1786400453.011604:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392949632 00000100:00100000:0.0:1786400453.011666:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786400453.011677:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392949632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400453.011718:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400453.011796:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392949632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400453.011804:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1786400453.012062:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e38a80 x1873176392949632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400453.012081:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392949632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400453.778961:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400453.924359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400453.924417:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368797056 00000100:00100000:1.0:1786400453.924417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400453.924428:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368797056 00000100:00100000:1.0:1786400453.924448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400453.924470:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400453.924476:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 254 00000100:00100000:2.0:1786400453.924486:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368797056:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400453.924493:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368797184 00000100:00100000:1.0:1786400453.924496:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368797184 00000100:00100000:1.0:1786400453.924534:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368797440 00000100:00100000:1.0:1786400453.924538:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368797440 00000100:00100000:2.0:1786400453.924552:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368797056:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400453.924556:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 112 00000100:00100000:2.0:1786400453.924561:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 254 00000100:00100000:1.0:1786400453.924562:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:2359:x1873176368797184:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400453.924593:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:2359:x1873176368797184:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400453.924599:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 112 00000100:00100000:1.0:1786400453.924612:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:1.0:1786400453.924617:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368797440:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400453.924640:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368797440:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 23us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400453.924646:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00080000:1.0:1786400453.924670:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400453.924727:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368797312 00000100:00100000:3.0:1786400453.924731:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368797312 00000100:00100000:3.0:1786400453.924803:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:3.0:1786400453.924811:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368797312:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400453.924848:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368797312:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 38us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400453.924855:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00080000:1.0:1786400453.925321:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1786400454.038068:0:6763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375779326121ns, next at 376779323341ns, rc = 0 00000100:00100000:2.0:1786400454.038105:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400454.038126:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392949760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400454.038207:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400454.038299:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392949760 00000100:00100000:2.0:1786400454.038307:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392949760 00000100:00100000:2.0:1786400454.038365:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786400454.038374:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392949760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400454.038412:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400454.038470:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392949760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400454.038477:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1786400454.038498:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400454.038529:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b75c0a80 x1873176392949760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400454.038549:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392949760:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1786400454.101407:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:1.0:1786400454.101438:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1786400454.101446:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1786400454.101470:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1786400454.101722:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400454.101961:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392949888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786400454.102030:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400454.102144:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392949888 00000100:00100000:0.0:1786400454.102152:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392949888 00000100:00100000:0.0:1786400454.102298:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786400454.102311:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392949888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786400454.102339:0:10836:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1786400454.102400:0:10836:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a7a4ec0, atime: 0x6a7a4ec0, ctime: 0x6a7a4ec0, blocks: 0x1 00010000:00010000:0.0:1786400454.102411:0:10836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400454.102499:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1786400454.102504:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400454.102511:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400454.102910:0:10836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400454.102921:0:10836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400454.102928:0:10836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400454.102987:0:10836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400454.112125:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400454.112144:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400454.112160:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c2176200 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400454.112166:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400454.112178:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400454.112241:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400454.112260:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a05266d/0x49554f35ff0a5340 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400454.119923:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b75c0a80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1786400454.119942:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392949888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786400454.121028:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392949888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18714us (18991us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1786400454.121042:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1786400454.121075:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400454.121078:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400454.121081:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400454.388458:0:11511:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1786400454.668317:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1786400454.808829:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786400455.589101:0:11560:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe40fc1d10 00000020:00000080:3.0:1786400455.589119:0:11560:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1786400455.589124:0:11560:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1786400455.589142:0:11560:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe40fc3fa0 20000000:00000080:3.0:1786400455.589151:0:11560:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff937388c78c00 uarg=0000000000000000 20000000:01000000:3.0:1786400455.589201:0:11560:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1786400455.589207:0:11560:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1786400455.589212:0:11560:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1786400455.590405:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1786400455.590593:0:11560:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1786400455.595369:0:11560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1786400455.595427:0:11560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1786400455.595486:0:11560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1786400455.595505:0:11560:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786400455.595526:0:11560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.595547:0:11560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.595555:0:11560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.595562:0:11560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.595568:0:11560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.595575:0:11560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a520c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.595582:0:11560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.595620:0:11560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a520c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.595634:0:11560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a520c expref: 18 pid: 5809 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400455.595662:0:11560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950016:0@lo:104: 00000100:00100000:1.0:1786400455.595725:0:11560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786400455.596089:0:11560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.596108:0:11560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 18 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400455.596117:0:11560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950144:0@lo:104: 00000100:00100000:0.0:1786400455.596142:0:11560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786400455.596322:0:11560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.596331:0:11560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 18 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400455.596339:0:11560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950272:0@lo:104: 00000100:00100000:0.0:1786400455.596363:0:11560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400455.596438:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392950016 00000100:00100000:3.0:1786400455.596452:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392950016 00000100:00100000:3.0:1786400455.596491:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392950144 00000100:00100000:3.0:1786400455.596494:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392950144 00000100:00100000:3.0:1786400455.596508:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786400455.596516:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+4:11560:x1873176392950016:12345-0@lo:104: 00010000:00010000:3.0:1786400455.596528:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596586:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400455.596593:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+4:11560:x1873176392950016:12345-0@lo:104: Request processed in 78us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400455.596600:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786400455.596617:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786400455.596624:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:11560:x1873176392950144:12345-0@lo:104: 00010000:00010000:3.0:1786400455.596631:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596664:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786400455.596669:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:11560:x1873176392950144:12345-0@lo:104: Request processed in 46us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400455.596674:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1786400455.596692:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786400455.596697:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596705:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400455.596709:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596729:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400455.596758:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400455.596765:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786400455.596799:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596807:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400455.596827:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596835:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937380031c00/0x49554f35ff0a520c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5213 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596848:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400455.596852:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596857:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400455.596860:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596866:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400455.596872:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400455.596882:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786400455.596896:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596901:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400455.596908:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596913:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937380030a00/0x49554f35ff0a51fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a5205 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.596936:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400455.596938:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400455.596940:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400455.596953:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392950400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400455.596983:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400455.597013:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400455.597019:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392950528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400455.597041:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400455.597069:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392950400 00000100:00100000:3.0:1786400455.597072:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392950400 00010000:00010000:3.0:1786400455.597089:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a520c expref: 19 pid: 5809 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400455.597108:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392950528 00000100:00100000:3.0:1786400455.597111:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392950528 00010000:00010000:3.0:1786400455.597121:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 20 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400455.597145:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786400455.597152:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+20:3317:x1873176392950400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400455.597161:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400455.597177:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a520c expref: 20 pid: 5809 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.597186:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a520c expref: 20 pid: 5809 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.597200:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400455.597309:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400455.597413:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+20:3317:x1873176392950400:12345-0@lo:103:ldlm_bl.0 Request processed in 261us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400455.597421:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786400455.597435:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786400455.597441:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392950528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400455.597449:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400455.597453:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 19 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.597461:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 19 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.597471:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400455.597492:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392950528:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400455.597498:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786400455.597538:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392950528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400455.597555:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392950400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400455.597718:0:11560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.597736:0:11560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 12 pid: 5811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400455.597767:0:11560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950656:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400455.597834:0:11560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.597843:0:11560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 12 pid: 5809 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400455.597852:0:11560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950784:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400455.597877:0:11560:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371840 going to sleep for 11 seconds 00010000:00010000:0.0:1786400455.597902:0:11560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a5213 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a520c expref: 18 pid: 5809 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400455.597912:0:11560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950016:0@lo:104: 00010000:00010000:0.0:1786400455.598507:0:11560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380030e00/0x49554f35ff0a5205 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a51fe expref: 17 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400455.598521:0:11560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950144:0@lo:104: 00000100:00100000:3.0:1786400455.598678:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786400455.598692:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392950272 00000100:00100000:3.0:1786400455.598697:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392950272 00000100:00100000:3.0:1786400455.598722:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400455.598729:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9372819d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:11560:x1873176392950272:12345-0@lo:104: 00010000:00010000:3.0:1786400455.598770:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400455.598823:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400455.598829:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9372819d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+3:11560:x1873176392950272:12345-0@lo:104: Request processed in 101us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400455.598836:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786400455.598946:0:11560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950272:0@lo:104: 00010000:00010000:1.0:1786400455.599046:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400455.599052:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.599060:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:1.0:1786400455.599063:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.599072:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400455.599078:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400455.599083:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786400455.599115:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.599122:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400455.599146:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.599152:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373bfebf600/0x49554f35ff0a51f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a51f7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.599175:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400455.599185:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400455.599187:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400455.599290:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392950912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400455.599324:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400455.599405:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392950912 00000100:00100000:1.0:1786400455.599410:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392950912 00010000:00010000:1.0:1786400455.599430:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 17 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400455.599459:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786400455.599467:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3315:x1873176392950912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400455.599476:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400455.599481:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 17 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.599490:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 17 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.599502:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a51f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a51f0 expref: 17 pid: 5810 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.599513:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400455.599540:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3315:x1873176392950912:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400455.599546:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786400455.599626:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392950912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400455.600376:0:11560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950656:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400455.600480:0:11560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11560:1873176392950784:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400455.600512:0:11560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400455.600677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400455.600713:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400455.600937:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368797696 00000100:00100000:0.0:1786400455.600943:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368797696 00010000:00010000:0.0:1786400455.600972:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 13 pid: 5809 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400455.600994:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368797568 00000100:00100000:0.0:1786400455.600997:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368797568 00010000:00010000:0.0:1786400455.601009:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 14 pid: 5811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400455.601022:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1786400455.601029:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+14:2362:x1873176368797696:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400455.601041:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400455.601047:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 14 pid: 5809 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601070:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 14 pid: 5809 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601086:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebe200/0x49554f35ff0a51e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f504f expref: 14 pid: 5809 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601099:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400455.601142:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368797696:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 112us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400455.601149:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1786400455.601196:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:0.0:1786400455.601205:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:2362:x1873176368797568:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400455.601213:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400455.601217:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 12 pid: 5811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601237:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 12 pid: 5811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601247:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebfe00/0x49554f35ff0a51e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5056 expref: 12 pid: 5811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601258:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601266:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601293:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601300:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601307:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601313:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601319:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400455.601323:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601330:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601343:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601351:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400455.601369:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:2362:x1873176368797568:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 166us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400455.601376:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00010000:00010000:0.0:1786400455.601395:0:11560:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601403:0:11560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400455.601416:0:11560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a5347 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400455.836060:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400456.851130:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400457.064025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400457.064136:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368797824 00000100:00100000:1.0:1786400457.064177:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368797824 00000100:00100000:1.0:1786400457.064234:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 255 00000100:00100000:1.0:1786400457.064244:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373910c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:5580:x1873176368797824:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400457.064261:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400457.064292:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a534e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50a3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.064320:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a534e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50a3 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.064332:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a534e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50a3 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.064341:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe800, rc 0) 00000100:00100000:1.0:1786400457.064403:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373910c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368797824:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 160us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.064410:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 255 00000100:00100000:1.0:1786400457.069288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400457.069369:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368797952 00000100:00100000:3.0:1786400457.069394:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368797952 00000100:00100000:3.0:1786400457.069453:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 256 00000100:00100000:3.0:1786400457.069463:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368797952:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400457.069985:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368797952:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 522us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400457.070003:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 256 00000100:00100000:3.0:1786400457.079454:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400457.079722:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368798080 00000100:00100000:2.0:1786400457.079732:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368798080 00000100:00100000:2.0:1786400457.079815:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 257 00000100:00100000:2.0:1786400457.079825:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368798080:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.080044:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368798080:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 219us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.080052:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 257 00000100:00100000:2.0:1786400457.088997:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400457.089097:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368798208 00000100:00100000:3.0:1786400457.089120:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368798208 00000100:00100000:3.0:1786400457.089190:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 258 00000100:00100000:3.0:1786400457.089205:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:9947:x1873176368798208:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786400457.089466:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:9947:x1873176368798208:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 266us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400457.089474:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 258 00000100:00100000:3.0:1786400457.106859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400457.110536:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368798336 00000100:00100000:1.0:1786400457.110555:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368798336 00000100:00100000:1.0:1786400457.110628:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 259 00000100:00100000:1.0:1786400457.110638:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:9947:x1873176368798336:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400457.110929:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:9947:x1873176368798336:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 291us (4090us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.110937:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 259 00000100:00100000:0.0:1786400457.134655:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400457.135015:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368798464 00000100:00100000:3.0:1786400457.135025:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368798464 00000100:00100000:3.0:1786400457.135082:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 260 00000100:00100000:3.0:1786400457.135092:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:5580:x1873176368798464:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400457.135119:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400457.135146:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399762200/0x49554f35ff0a5355 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50aa expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400457.135176:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399762200/0x49554f35ff0a5355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50aa expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400457.135187:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399762200/0x49554f35ff0a5355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50aa expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400457.135204:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762200, rc 0) 00000100:00100000:3.0:1786400457.135270:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368798464:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 179us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400457.135292:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 260 00000100:00100000:3.0:1786400457.137796:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400457.137913:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368798592 00000100:00100000:1.0:1786400457.137924:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368798592 00000100:00100000:1.0:1786400457.137982:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 261 00000100:00100000:1.0:1786400457.137992:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368798592:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400457.138466:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368798592:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 474us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.138486:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 261 00000100:00100000:1.0:1786400457.141862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400457.141994:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368798720 00000100:00100000:0.0:1786400457.142004:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368798720 00000100:00100000:0.0:1786400457.142060:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 262 00000100:00100000:0.0:1786400457.142070:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368798720:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400457.142327:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:5580:x1873176368798720:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 258us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400457.142336:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 262 00000100:00100000:0.0:1786400457.149278:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400457.153808:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368798848 00000100:00100000:3.0:1786400457.153824:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368798848 00000100:00100000:3.0:1786400457.155034:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 263 00000100:00100000:3.0:1786400457.155051:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:9950:x1873176368798848:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400457.161571:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:9950:x1873176368798848:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 6514us (12291us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.161586:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 263 00000100:00100000:3.0:1786400457.174624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400457.174824:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368798976 00000100:00100000:1.0:1786400457.174835:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368798976 00000100:00100000:1.0:1786400457.174895:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 264 00000100:00100000:1.0:1786400457.174905:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:9950:x1873176368798976:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400457.175413:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:9950:x1873176368798976:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 507us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.175423:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 264 10000000:01000000:0.0:1786400457.299812:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786400457.299820:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373bf25e800 from 7 10000000:01000000:0.0:1786400457.299825:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400457.299877:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400457.299891:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400457.299903:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400457.299931:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400457.300018:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400457.300083:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373878ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1786400457.300408:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392951040 00000100:00100000:1.0:1786400457.300417:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392951040 00000100:00100000:1.0:1786400457.300472:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1786400457.300482:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:5813:x1873176392951040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400457.300494:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400457.300507:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a5363 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a535c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.300529:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a5363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a535c expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.300540:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a5363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a535c expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.300560:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebec00, rc 0) 00000100:00100000:1.0:1786400457.300618:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392951040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.300625:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1786400457.303608:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400457.303639:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.303652:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400457.303735:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.303836:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400457.303887:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400457.304912:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392951168 00000100:00100000:1.0:1786400457.304922:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392951168 00000100:00100000:1.0:1786400457.304991:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1786400457.305002:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392951168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400457.305509:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392951168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 507us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.305518:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1786400457.306947:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400457.307023:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400457.307089:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400457.307152:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373878ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1786400457.307344:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392951296 00000100:00100000:3.0:1786400457.307351:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392951296 00000100:00100000:3.0:1786400457.307398:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1786400457.307406:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392951296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400457.307587:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392951296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400457.307594:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1786400457.307800:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400457.312421:0:11574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11574:1873176392951424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400457.312517:0:11574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400457.312567:0:11574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371840 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.312672:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392951424 00000100:00100000:2.0:1786400457.312681:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392951424 00000100:00100000:2.0:1786400457.312734:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1786400457.312772:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:11574:x1873176392951424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400457.313040:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:11574:x1873176392951424:12345-0@lo:502:llog_process_th.0 Request processed in 269us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.313049:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1786400457.313553:0:11574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11574:1873176392951424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400457.313590:0:11574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400457.313601:0:11574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400457.313604:0:11574:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1786400457.313612:0:11574:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9373bf25e800 00000020:00000080:1.0:1786400457.313615:0:11574:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786400457.313728:0:11574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11574:1873176392951552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400457.313797:0:11574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400457.313839:0:11574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371840 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.317674:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392951552 00000100:00100000:2.0:1786400457.317689:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392951552 00000100:00100000:2.0:1786400457.317775:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1786400457.317786:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:11574:x1873176392951552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400457.318068:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:11574:x1873176392951552:12345-0@lo:502:llog_process_th.0 Request processed in 284us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.318076:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1786400457.318889:0:11574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11574:1873176392951552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400457.319176:0:11574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400457.319185:0:11574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400457.319188:0:11574:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1786400457.319264:0:11574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1786400457.320064:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1786400457.320089:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400457.320101:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.320126:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400457.320148:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786400457.320151:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373b7b4b000 from 7 10000000:01000000:2.0:1786400457.320154:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786400457.320201:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.320218:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.320229:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400457.320252:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.320308:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400457.320349:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400457.321500:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392951680 00000100:00100000:1.0:1786400457.321510:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392951680 00000100:00100000:1.0:1786400457.321557:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1786400457.321567:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:5813:x1873176392951680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400457.321581:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400457.321597:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebe000/0x49554f35ff0a5371 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a536a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.321622:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebe000/0x49554f35ff0a5371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a536a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.321634:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebe000/0x49554f35ff0a5371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a536a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.321656:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe000, rc 0) 00000100:00100000:1.0:1786400457.321733:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392951680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.321761:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1786400457.321870:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400457.321887:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400457.321910:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400457.321988:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400457.322019:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.322054:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738da54540 going to sleep for 11 seconds 00000100:00100000:1.0:1786400457.322454:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392951808 00000100:00100000:1.0:1786400457.322459:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392951808 00000100:00100000:1.0:1786400457.322493:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1786400457.322501:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392951808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400457.323333:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392951808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 829us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.323354:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1786400457.323472:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400457.323521:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400457.323563:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.323588:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738da54540 going to sleep for 11 seconds 00000100:00100000:3.0:1786400457.323605:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392951936 00000100:00100000:3.0:1786400457.323609:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392951936 00000100:00100000:3.0:1786400457.323627:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1786400457.323633:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392951936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400457.324803:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392951936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1164us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400457.324814:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1786400457.324879:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392951936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400457.328357:0:11576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11576:1873176392952064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400457.328455:0:11576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.328493:0:11576:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738da54000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.328604:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392952064 00000100:00100000:2.0:1786400457.328610:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392952064 00000100:00100000:2.0:1786400457.328674:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1786400457.328683:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:11576:x1873176392952064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400457.328942:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:11576:x1873176392952064:12345-0@lo:502:llog_process_th.0 Request processed in 258us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.329459:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1786400457.329678:0:11576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11576:1873176392952064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786400457.329713:0:11576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400457.329722:0:11576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400457.329724:0:11576:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1786400457.329732:0:11576:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9373b7b4b000 00000020:00000080:3.0:1786400457.329734:0:11576:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786400457.329851:0:11576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11576:1873176392952192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400457.329898:0:11576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.329936:0:11576:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738da54000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.330307:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392952192 00000100:00100000:2.0:1786400457.330313:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392952192 00000100:00100000:2.0:1786400457.330346:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1786400457.330353:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:11576:x1873176392952192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400457.330534:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+18:11576:x1873176392952192:12345-0@lo:502:llog_process_th.0 Request processed in 181us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.330542:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1786400457.330631:0:11576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11576:1873176392952192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786400457.331859:0:11576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400457.331875:0:11576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400457.331877:0:11576:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1786400457.331883:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1786400457.334180:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1786400457.334293:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786400457.334307:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.334322:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400457.334333:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786400457.334336:0:5813:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373910fb800 from 7 10000000:01000000:1.0:1786400457.334339:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786400457.334380:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.334388:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400457.334400:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400457.334734:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392952320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400457.334821:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400457.334871:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373811ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.337339:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392952320 00000100:00100000:2.0:1786400457.337358:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392952320 00000100:00100000:2.0:1786400457.337433:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1786400457.337450:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:5813:x1873176392952320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400457.337467:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400457.337483:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b7a1f600/0x49554f35ff0a537f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a5378 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.337512:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b7a1f600/0x49554f35ff0a537f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a5378 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.337523:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b7a1f600/0x49554f35ff0a537f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a5378 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.337532:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f600, rc 0) 00000100:00100000:2.0:1786400457.337609:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392952320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.337615:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1786400457.337671:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392952320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400457.337688:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.337698:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400457.337791:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392952448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.337823:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400457.337853:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.337867:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392952448 00000100:00100000:2.0:1786400457.337870:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392952448 00000100:00100000:2.0:1786400457.337900:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1786400457.337915:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392952448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.338330:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392952448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 415us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.338338:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1786400457.338370:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392952448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.338402:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392952576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.338439:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400457.338453:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.338466:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392952576 00000100:00100000:2.0:1786400457.338470:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392952576 00000100:00100000:2.0:1786400457.338487:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1786400457.338493:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392952576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.338627:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:5813:x1873176392952576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.338634:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1786400457.338670:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e769e6f-cf99-4814-98f1-5b8d54010374:5813:1873176392952576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400457.338884:0:11578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11578:1873176392952704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400457.338918:0:11578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400457.338937:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392952704 00000100:00100000:2.0:1786400457.338941:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392952704 00000100:00100000:2.0:1786400457.344305:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1786400457.344326:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:11578:x1873176392952704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400457.344589:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:11578:x1873176392952704:12345-0@lo:502:llog_process_th.0 Request processed in 270us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.344606:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1786400457.359837:0:11578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048c480 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.359891:0:11578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11578:1873176392952704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786400457.359945:0:11578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400457.360791:0:11578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400457.360795:0:11578:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786400457.360806:0:11578:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9373910fb800 00000020:00000080:2.0:1786400457.360809:0:11578:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786400457.361044:0:11578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11578:1873176392952832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400457.361289:0:11578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400457.361337:0:11578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048c480 going to sleep for 11 seconds 00000100:00100000:2.0:1786400457.361384:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392952832 00000100:00100000:2.0:1786400457.361393:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392952832 00000100:00100000:2.0:1786400457.361448:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1786400457.361456:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:11578:x1873176392952832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400457.361676:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:11578:x1873176392952832:12345-0@lo:502:llog_process_th.0 Request processed in 219us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400457.361684:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1786400457.361769:0:11578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e769e6f-cf99-4814-98f1-5b8d54010374:11578:1873176392952832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786400457.361795:0:11578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400457.361800:0:11578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400457.361802:0:11578:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1786400457.361806:0:11578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1786400457.361866:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1786400457.361881:0:5813:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400457.365304:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400457.365352:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400457.375434:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1786400457.619017:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392953216:0@lo:400:kworker.0 00000100:00100000:2.0:1786400457.619045:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392953088:0@lo:400:kworker.0 00000100:00100000:0.0:1786400457.619127:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392952960:0@lo:400:kworker.0 00000100:00100000:1.0:1786400457.619194:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392953344:0@lo:400:kworker.0 00000100:00100000:3.0:1786400457.625343:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.625457:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392953216 00000100:00100000:3.0:1786400457.625466:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392953216 00000100:00100000:3.0:1786400457.625528:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786400457.625537:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392953216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400457.625608:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392953216:12345-0@lo:400:kworker.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400457.625615:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1786400457.625636:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400457.625665:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1786400457.625671:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b75c0a80, transno 4294967300 00000100:00100000:3.0:1786400457.625683:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392953216:0@lo:400:kworker.0 00000100:00100000:2.0:1786400457.626892:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.627765:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392953088 00000100:00100000:3.0:1786400457.627773:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392953088 00000100:00100000:0.0:1786400457.627776:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.627822:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392952960 00000100:00100000:3.0:1786400457.627825:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392952960 00000100:00100000:0.0:1786400457.627827:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392953472:0@lo:400:kworker.0 00000100:00100000:3.0:1786400457.627845:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1786400457.627859:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392953088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400457.627880:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.627913:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392953088:12345-0@lo:400:kworker.0 Request processed in 61us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400457.627920:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1786400457.627921:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392953472 00000100:00100000:0.0:1786400457.627925:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392953472 00000100:00100000:3.0:1786400457.627936:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1786400457.627941:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392952960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400457.627964:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786400457.627970:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392953472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400457.628006:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392953472:12345-0@lo:400:kworker.0 Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400457.628012:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1786400457.628052:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b9e39880 x1873176392953472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400457.628065:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392953472:0@lo:400:kworker.0 00000100:00080000:2.0:1786400457.628421:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400457.628426:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400457.628452:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392953088:0@lo:400:kworker.0 00000100:00100000:3.0:1786400457.628620:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392952960:12345-0@lo:400:kworker.0 Request processed in 677us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400457.628626:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400457.628627:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1786400457.628678:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392952960:0@lo:400:kworker.0 00000100:00100000:3.0:1786400457.636139:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392953344 00000100:00100000:3.0:1786400457.636152:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392953344 00000100:00100000:3.0:1786400457.636401:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786400457.636412:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392953344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400457.636507:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392953344:12345-0@lo:400:kworker.0 Request processed in 97us (7879us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400457.636514:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1786400457.636573:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400457.640536:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392953344:0@lo:400:kworker.0 00010000:00010000:1.0:1786400457.875032:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400458.131064:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392953600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400458.131149:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400458.131270:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392953600 00000100:00100000:3.0:1786400458.131279:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392953600 00000100:00100000:3.0:1786400458.131339:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1786400458.131348:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392953600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400458.131386:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400458.137375:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392953600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6017us (6215us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400458.137392:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1786400458.141165:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937385d7df80 x1873176392953600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400458.141194:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392953600:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786400458.387426:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786400458.898942:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400459.040297:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400459.040339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400459.040374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400459.040397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400459.040432:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368799232 00000100:00100000:3.0:1786400459.040440:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368799232 00000100:00100000:3.0:1786400459.040495:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368799488 00000100:00100000:3.0:1786400459.040498:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368799488 00000100:00100000:3.0:1786400459.040521:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:3.0:1786400459.040530:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368799232:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400459.040601:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368799104 00000100:00100000:2.0:1786400459.040605:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368799104 00000100:00100000:3.0:1786400459.040632:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368799232:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400459.040633:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 280 00000100:00100000:2.0:1786400459.040639:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368799104:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400459.040640:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:3.0:1786400459.040656:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:3.0:1786400459.040663:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368799488:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400459.040664:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368799104:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400459.040669:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 280 00000100:00100000:3.0:1786400459.040683:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368799488:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 21us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400459.040689:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00080000:2.0:1786400459.040712:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400459.041159:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368799360 00000100:00100000:1.0:1786400459.041163:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368799360 00000100:00100000:1.0:1786400459.041207:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:1.0:1786400459.041215:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368799360:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400459.041250:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368799360:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 36us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400459.041256:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00080000:2.0:1786400459.041310:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400459.157707:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400459.157728:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392953728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400459.157838:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400459.158046:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392953728 00000100:00100000:1.0:1786400459.158054:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392953728 00000100:00080000:1.0:1786400459.158115:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400459.158229:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786400459.158239:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392953728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400459.158273:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400459.158327:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392953728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400459.158334:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786400459.162854:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392953728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786400459.922995:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400460.946948:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400461.972601:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400462.741228:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392954240:0@lo:400:kworker.0 00000100:00100000:0.0:1786400462.741298:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400462.741360:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400462.741366:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392954112:0@lo:400:kworker.0 00000100:00100000:0.0:1786400462.741401:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400462.741433:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392954240 00000100:00100000:0.0:1786400462.741439:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392954240 00000100:00100000:1.0:1786400462.741633:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392953856:0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.741669:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400462.741693:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392954368:0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.741714:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400462.741730:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786400462.741735:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392953984:0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.741790:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400462.741808:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392954496:0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.741829:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400462.741856:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392954112 00000100:00100000:1.0:1786400462.741861:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392954112 00000100:00100000:1.0:1786400462.741892:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392954368 00000100:00100000:1.0:1786400462.741908:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392954368 00000100:00100000:1.0:1786400462.741926:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392953984 00000100:00100000:1.0:1786400462.741929:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392953984 00000100:00100000:1.0:1786400462.741942:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1786400462.741950:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392954112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.742000:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392954112:12345-0@lo:400:kworker.0 Request processed in 49us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400462.742007:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1786400462.742024:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1786400462.742030:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392954368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.742074:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392954368:12345-0@lo:400:kworker.0 Request processed in 45us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400462.742080:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1786400462.742091:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1786400462.742096:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392953984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.742121:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392953984:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400462.742126:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1786400462.742172:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392953984:0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.742183:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392954368:0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.742228:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392954496 00000100:00100000:1.0:1786400462.742231:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392954496 00000100:00100000:1.0:1786400462.742257:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786400462.742263:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392954496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.742295:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392954496:12345-0@lo:400:kworker.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400462.742311:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1786400462.742328:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400462.742333:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786400462.742334:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786400462.742354:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937385d7e300 x1873176392954496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400462.742364:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392954496:0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.742395:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392954112:0@lo:400:kworker.0 00000100:00100000:3.0:1786400462.742966:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392953856 00000100:00100000:3.0:1786400462.742972:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392953856 00000100:00100000:3.0:1786400462.743010:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1786400462.743018:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392953856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400462.743077:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392953856:12345-0@lo:400:kworker.0 Request processed in 60us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400462.743084:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786400462.743262:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786400462.743271:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392954240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400462.743320:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392954240:12345-0@lo:400:kworker.0 Request processed in 52us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400462.743326:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786400462.743411:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392954240:0@lo:400:kworker.0 00000100:00100000:1.0:1786400462.743911:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392953856:0@lo:400:kworker.0 00010000:00010000:1.0:1786400462.995993:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400463.251753:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392954624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400463.251826:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400463.252122:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392954624 00000100:00100000:1.0:1786400463.252131:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392954624 00000100:00100000:1.0:1786400463.252191:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786400463.252201:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392954624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400463.252248:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400463.252310:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392954624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400463.252318:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1786400463.252525:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b79c8700 x1873176392954624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400463.252545:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392954624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786400464.020659:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400464.164200:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400464.164266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400464.164309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400464.164390:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400464.164417:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368799744 00000100:00100000:2.0:1786400464.164428:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368799744 00000100:00100000:2.0:1786400464.164490:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368800000 00000100:00100000:2.0:1786400464.164494:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368800000 00000100:00100000:0.0:1786400464.164518:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368799616 00000100:00100000:0.0:1786400464.164522:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368799616 00000100:00100000:2.0:1786400464.164528:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:2.0:1786400464.164537:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368799744:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400464.164548:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 282 00000100:00100000:0.0:1786400464.164553:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368799616:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400464.164607:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368799744:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 70us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400464.164615:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00080000:3.0:1786400464.164688:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400464.164951:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368799616:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 396us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400464.164958:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 282 00000100:00100000:0.0:1786400464.164998:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368799872 00000100:00100000:0.0:1786400464.165007:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368799872 00000100:00100000:0.0:1786400464.165052:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:0.0:1786400464.165058:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368799872:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400464.165084:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368799872:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400464.165089:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00080000:0.0:1786400464.165103:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400464.165249:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:1.0:1786400464.165259:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368800000:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400464.165289:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368800000:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400464.165295:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:3.0:1786400464.276304:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400464.276329:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392954752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400464.276406:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400464.276579:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392954752 00000100:00100000:2.0:1786400464.276588:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392954752 00000100:00100000:2.0:1786400464.276656:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1786400464.276665:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392954752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400464.276698:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1786400464.276704:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400464.276776:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392954752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400464.276784:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786400464.278680:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392954752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786400465.044586:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400466.072947:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400467.092714:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400467.859766:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400467.859859:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400467.859887:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392955008:0@lo:400:kworker.0 00000100:00100000:1.0:1786400467.859994:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400467.860159:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392955008 00000100:00100000:3.0:1786400467.860168:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392955008 00000100:00100000:3.0:1786400467.860230:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1786400467.860240:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392955008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400467.860312:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392955008:12345-0@lo:400:kworker.0 Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400467.860320:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1786400467.860371:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392955008:0@lo:400:kworker.0 00000100:00100000:2.0:1786400467.861474:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392954880:0@lo:400:kworker.0 00000100:00100000:2.0:1786400467.861530:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400467.861837:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392955136:0@lo:400:kworker.0 00000100:00100000:0.0:1786400467.861867:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400467.861895:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400467.861901:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392955264:0@lo:400:kworker.0 00000100:00100000:1.0:1786400467.862473:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392955392:0@lo:400:kworker.0 00000100:00100000:2.0:1786400467.862541:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392955520:0@lo:400:kworker.0 00000100:00100000:3.0:1786400467.862722:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392954880 00000100:00100000:3.0:1786400467.862730:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392954880 00000100:00100000:3.0:1786400467.862804:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1786400467.862812:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392954880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400467.864686:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400467.864825:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392955136 00000100:00100000:1.0:1786400467.864832:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392955136 00000100:00100000:1.0:1786400467.864893:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392955392 00000100:00100000:1.0:1786400467.864896:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392955392 00000100:00100000:1.0:1786400467.864930:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1786400467.864940:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392955136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400467.865017:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392955136:12345-0@lo:400:kworker.0 Request processed in 69us (3138us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400467.865025:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1786400467.865041:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1786400467.865047:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392955392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400467.865078:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392955392:12345-0@lo:400:kworker.0 Request processed in 32us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400467.865095:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1786400467.865443:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392955392:0@lo:400:kworker.0 00000100:00080000:1.0:1786400467.865477:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400467.866098:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400467.866307:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392955520 00000100:00100000:1.0:1786400467.866314:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392955520 00000100:00100000:1.0:1786400467.866370:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786400467.866390:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392955520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400467.866433:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392955520:12345-0@lo:400:kworker.0 Request processed in 44us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400467.866439:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1786400467.866456:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1786400467.870466:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c66680 x1873176392955520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400467.870484:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392955520:0@lo:400:kworker.0 00000100:00100000:0.0:1786400467.870767:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400467.870828:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392955136:0@lo:400:kworker.0 00000100:00100000:1.0:1786400467.871039:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392955264 00000100:00100000:1.0:1786400467.871047:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392955264 00000100:00100000:1.0:1786400467.871123:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786400467.871141:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392955264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400467.871205:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392955264:12345-0@lo:400:kworker.0 Request processed in 66us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400467.871212:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1786400467.872582:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400467.872639:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392955264:0@lo:400:kworker.0 00000100:00100000:3.0:1786400467.874782:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392954880:12345-0@lo:400:kworker.0 Request processed in 11963us (13243us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400467.874806:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1786400467.880247:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392954880:0@lo:400:kworker.0 00010000:00010000:1.0:1786400468.117569:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400468.372252:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392955648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400468.372333:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400468.373768:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392955648 00000100:00100000:3.0:1786400468.373788:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392955648 00000100:00100000:3.0:1786400468.373846:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786400468.373855:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392955648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400468.373894:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400468.373977:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392955648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400468.374006:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1786400468.375284:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c65180 x1873176392955648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400468.375311:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392955648:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786400468.631306:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786400469.140012:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400469.287232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400469.287293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400469.287317:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368800128 00000100:00100000:0.0:1786400469.287339:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368800128 00000100:00100000:1.0:1786400469.287555:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368800256 00000100:00100000:1.0:1786400469.287561:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368800256 00000100:00100000:1.0:1786400469.287648:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 127 00000100:00100000:1.0:1786400469.287675:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368800256:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400469.287814:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368800256:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 151us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400469.287823:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 127 00000100:00080000:2.0:1786400469.288035:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400469.289148:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 284 00000100:00100000:0.0:1786400469.289157:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368800128:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400469.289214:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368800128:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 58us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400469.289221:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 284 00000100:00100000:3.0:1786400469.315859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400469.316019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400469.316120:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368800512 00000100:00100000:2.0:1786400469.316131:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368800512 00000100:00100000:2.0:1786400469.316193:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 128 00000100:00100000:2.0:1786400469.316200:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368800512:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400469.316265:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368800512:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400469.316272:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 128 00000100:00080000:0.0:1786400469.316595:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400469.316657:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368800384 00000100:00100000:1.0:1786400469.316662:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368800384 00000100:00100000:1.0:1786400469.316712:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:1.0:1786400469.316719:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2358:x1873176368800384:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:1.0:1786400469.316760:0:6624:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a52bb 00000100:00080000:1.0:1786400469.316778:0:6624:0:(import.c:65:import_set_state_nolock()) ffff9373b890c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786400469.316828:0:6624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:0.0:1786400469.317021:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400469.317041:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400469.317633:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+2:2358:x1873176368800384:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 911us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400469.317642:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:3.0:1786400469.398726:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392955776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400469.398829:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400469.398920:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392955776 00000100:00100000:3.0:1786400469.398959:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392955776 00000100:00100000:3.0:1786400469.399039:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786400469.399049:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392955776:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786400469.399085:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1786400469.399102:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400469.399162:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392955776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400469.399264:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392955776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400469.406624:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000001:00100000:0.0:1786400470.039331:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:0.0:1786400470.039343:0:6647:0:(genops.c:906:class_export_put()) final put ffff9373b890e000/2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:1.0:1786400470.039531:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b890e000/2e546c9b-fa03-4565-a5c8-6992a70a28db for lustre-OST0000 00000020:00000080:1.0:1786400470.039583:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373b890c800 for lustre-OST0000 00010000:00010000:1.0:1786400470.163016:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400471.191341:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400472.211170:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400472.979325:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392956032:0@lo:400:kworker.0 00000100:00100000:0.0:1786400472.979337:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392956160:0@lo:400:kworker.0 00000100:00100000:0.0:1786400472.979410:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400472.979415:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392956288:0@lo:400:kworker.0 00000100:00100000:1.0:1786400472.979422:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392955904:0@lo:400:kworker.0 00000100:00100000:3.0:1786400472.979482:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392956160 00000100:00100000:3.0:1786400472.979491:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392956160 00000100:00100000:3.0:1786400472.979552:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1786400472.979563:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392956160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400472.980238:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786400472.980773:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400472.980796:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400472.980822:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392956544:0@lo:400:kworker.0 00000100:00100000:2.0:1786400472.980848:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400472.980910:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392956032 00000100:00100000:2.0:1786400472.980914:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392956032 00000100:00100000:2.0:1786400472.980945:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1786400472.980952:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392956032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400472.980995:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392956032:12345-0@lo:400:kworker.0 Request processed in 43us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400472.981003:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1786400472.981025:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392956288 00000100:00100000:2.0:1786400472.981029:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392956288 00000100:00100000:2.0:1786400472.981056:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392956544 00000100:00100000:2.0:1786400472.981059:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392956544 00000100:00100000:2.0:1786400472.981079:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786400472.981084:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392956288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400472.981117:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392956288:12345-0@lo:400:kworker.0 Request processed in 32us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400472.981123:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786400472.981134:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786400472.981140:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392956544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400472.981165:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392956544:12345-0@lo:400:kworker.0 Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400472.981171:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1786400472.981187:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400472.981190:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400472.981215:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392956288:0@lo:400:kworker.0 00000100:00100000:2.0:1786400472.981244:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392956032:0@lo:400:kworker.0 00010000:00080000:2.0:1786400472.981254:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe45f80 x1873176392956544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400472.981275:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392956544:0@lo:400:kworker.0 00000100:00100000:3.0:1786400472.983831:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392956160:12345-0@lo:400:kworker.0 Request processed in 4266us (4417us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400472.983845:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1786400472.983906:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400472.983951:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392956416:0@lo:400:kworker.0 00000100:00100000:1.0:1786400472.983978:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400472.984000:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392955904 00000100:00100000:3.0:1786400472.984008:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392955904 00000100:00100000:3.0:1786400472.984064:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1786400472.984072:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392956160:0@lo:400:kworker.0 00000100:00100000:3.0:1786400472.984076:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392955904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400472.984151:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392955904:12345-0@lo:400:kworker.0 Request processed in 79us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400472.984157:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1786400472.984272:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392956416 00000100:00100000:2.0:1786400472.984276:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392956416 00000100:00100000:2.0:1786400472.984326:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1786400472.984333:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392956416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400472.984368:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392956416:12345-0@lo:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400472.984375:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1786400472.984428:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400472.984514:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392955904:0@lo:400:kworker.0 00000100:00100000:0.0:1786400472.984527:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392956416:0@lo:400:kworker.0 00010000:00010000:0.0:1786400473.236926:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400473.491420:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400473.491446:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392956672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400473.491517:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400473.491667:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392956672 00000100:00100000:1.0:1786400473.491675:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392956672 00000100:00100000:1.0:1786400473.491771:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786400473.491781:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392956672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400473.491818:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400473.491878:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392956672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400473.491885:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1786400473.496898:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937388c66680 x1873176392956672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400473.496940:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392956672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786400474.258974:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400474.402633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400474.402781:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368800640 00000100:00100000:0.0:1786400474.402792:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368800640 00000100:00100000:0.0:1786400474.402863:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 286 00000100:00100000:0.0:1786400474.402873:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368800640:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400474.402951:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368800640:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 80us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400474.402959:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 286 00000100:00100000:2.0:1786400474.408066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400474.408300:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368800768 00000100:00100000:3.0:1786400474.408318:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368800768 00000100:00080000:2.0:1786400474.408518:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400474.408547:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 132 00000100:00100000:3.0:1786400474.408563:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368800768:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400474.408690:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368800768:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 131us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400474.408699:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 132 00000100:00100000:0.0:1786400474.409870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400474.414377:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368800896 00000100:00100000:3.0:1786400474.414402:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368800896 00000100:00100000:3.0:1786400474.414526:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 133 00000100:00100000:3.0:1786400474.414538:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368800896:12345-192.168.201.23@tcp:400:kworker.0 00000100:00080000:2.0:1786400474.414593:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400474.414662:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368800896:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 125us (4798us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400474.414673:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 133 00000100:00100000:2.0:1786400474.515607:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400474.515633:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392956800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400474.515732:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400474.516243:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392956800 00000100:00100000:0.0:1786400474.516252:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392956800 00000100:00100000:0.0:1786400474.516316:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786400474.516326:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392956800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400474.516368:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400474.516416:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392956800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400474.516424:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786400474.516468:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392956800:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786400474.518150:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400475.283142:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400476.309282:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400477.334941:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400478.099067:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392956928:0@lo:400:kworker.0 00000100:00100000:1.0:1786400478.099142:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400478.099290:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400478.099299:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392957056:0@lo:400:kworker.0 00000100:00100000:1.0:1786400478.099335:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400478.099374:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392956928 00000100:00100000:1.0:1786400478.099381:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392956928 00000100:00100000:1.0:1786400478.099433:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1786400478.099443:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392956928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400478.099494:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392956928:12345-0@lo:400:kworker.0 Request processed in 53us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400478.099502:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1786400478.099547:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392956928:0@lo:400:kworker.0 00000100:00100000:1.0:1786400478.099858:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392957056 00000100:00100000:1.0:1786400478.099863:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392957056 00000100:00100000:1.0:1786400478.099894:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1786400478.099901:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392957056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.100132:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392957184:0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.100165:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400478.100187:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400478.100193:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392957312:0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.100216:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400478.100243:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392957184 00000100:00100000:0.0:1786400478.100247:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392957184 00000100:00100000:0.0:1786400478.100277:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1786400478.100297:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392957184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.100333:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392957184:12345-0@lo:400:kworker.0 Request processed in 37us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400478.100340:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1786400478.100360:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392957312 00000100:00100000:0.0:1786400478.100363:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392957312 00000100:00100000:0.0:1786400478.100389:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1786400478.100395:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392957312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.100439:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392957312:12345-0@lo:400:kworker.0 Request processed in 44us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400478.100445:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1786400478.100468:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786400478.100473:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400478.100497:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392957312:0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.100507:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392957184:0@lo:400:kworker.0 00000100:00100000:1.0:1786400478.100823:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392957056:12345-0@lo:400:kworker.0 Request processed in 922us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400478.103123:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392957440:0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.103218:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400478.103297:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392957056:0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.103346:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392957440 00000100:00100000:0.0:1786400478.103352:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392957440 00000100:00100000:0.0:1786400478.103416:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1786400478.103425:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392957440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.103488:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392957440:12345-0@lo:400:kworker.0 Request processed in 63us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400478.103495:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1786400478.103518:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400478.103541:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392957440:0@lo:400:kworker.0 00000100:00100000:1.0:1786400478.103719:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1786400478.104394:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392957568:0@lo:400:kworker.0 00000100:00100000:0.0:1786400478.104514:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400478.104675:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392957568 00000100:00100000:1.0:1786400478.104681:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392957568 00000100:00100000:1.0:1786400478.104787:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786400478.104797:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392957568:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786400478.104888:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400478.105058:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392957568:12345-0@lo:400:kworker.0 Request processed in 262us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400478.105066:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1786400478.106338:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe46d80 x1873176392957568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400478.106360:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392957568:0@lo:400:kworker.0 00010000:00010000:1.0:1786400478.360370:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400478.612720:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392957696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400478.612834:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400478.612942:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392957696 00000100:00100000:0.0:1786400478.612962:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392957696 00000100:00100000:0.0:1786400478.613015:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786400478.613022:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392957696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400478.613055:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400478.613095:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392957696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400478.613102:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1786400478.613151:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373984c5500 x1873176392957696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400478.613170:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392957696:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1786400478.867683:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786400479.381245:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400479.542230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400479.542263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400479.542309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400479.542335:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368801024 00000100:00100000:1.0:1786400479.542344:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368801024 00000100:00100000:1.0:1786400479.542389:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 288 00000100:00100000:1.0:1786400479.542399:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368801024:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400479.542466:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2359:x1873176368801024:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400479.542474:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 288 00000100:00100000:0.0:1786400479.542553:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368801152 00000100:00100000:0.0:1786400479.542558:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368801152 00000100:00100000:0.0:1786400479.542601:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368801280 00000100:00100000:0.0:1786400479.542604:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368801280 00000100:00100000:0.0:1786400479.542637:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 137 00000100:00100000:0.0:1786400479.542644:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368801152:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400479.542676:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368801152:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400479.542682:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 137 00000100:00100000:0.0:1786400479.542693:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 138 00000100:00100000:0.0:1786400479.542698:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368801280:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400479.542718:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368801280:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 20us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400479.542724:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 138 00000100:00080000:1.0:1786400479.543280:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400479.642215:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400479.642240:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392957824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400479.642311:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400479.642375:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392957824 00000100:00100000:2.0:1786400479.642384:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392957824 00000100:00100000:2.0:1786400479.642431:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786400479.642440:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392957824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400479.642476:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400479.642521:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392957824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400479.642547:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786400479.642600:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392957824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400480.403148:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786400480.439362:0:11739:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:21:18 (1786400478) 00010000:00010000:2.0:1786400481.428565:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400482.165809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400482.166121:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368801408 00000100:00100000:0.0:1786400482.166133:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368801408 00000100:00100000:0.0:1786400482.166229:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:0.0:1786400482.166239:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:10218:x1873176368801408:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400482.166264:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400482.166291:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50b1 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.166357:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a538d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.166371:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a538d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.166385:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a538d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400482.166601:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786400482.166605:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400482.166694:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a538d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.166732:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50b1 expref: 7 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.166787:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a538d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50b1 expref: 6 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.167091:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128d500) 00010000:00010000:0.0:1786400482.167095:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400482.167106:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c2176400, rc 0) 00000100:00080000:1.0:1786400482.167317:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400482.167903:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:10218:x1873176368801408:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 1663us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400482.167914:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:2.0:1786400482.180430:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400482.180590:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368801536 00000100:00100000:0.0:1786400482.180600:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368801536 00000100:00100000:0.0:1786400482.180671:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1786400482.180681:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:10219:x1873176368801536:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400482.180714:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400482.180735:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.181647:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.181660:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.181670:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.181686:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.181693:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.181700:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.184472:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030a00/0x49554f35ff0a53a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.185584:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030a00/0x49554f35ff0a53a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.185598:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030a00/0x49554f35ff0a53a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400482.185790:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786400482.187369:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400482.187937:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380030a00/0x49554f35ff0a53a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.187953:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.187957:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.187963:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.187967:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c2176200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400482.187970:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.187974:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.187986:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128d500) 00010000:00010000:0.0:1786400482.187988:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400482.187991:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188003:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a539b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188017:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188020:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188024:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188027:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400482.188029:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188032:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188036:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93739128d100) 00010000:00010000:0.0:1786400482.188037:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400482.188039:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188042:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188084:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50b8 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188093:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030a00/0x49554f35ff0a53a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50b8 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.188103:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93739128de00) 00010000:00010000:0.0:1786400482.188104:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400482.188106:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030a00, rc 0) 00000100:00100000:0.0:1786400482.188191:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:10219:x1873176368801536:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 7511us (7773us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400482.188198:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:2.0:1786400482.198310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400482.198408:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368801792 00000100:00100000:0.0:1786400482.198418:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368801792 00000100:00100000:0.0:1786400482.198482:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:0.0:1786400482.198561:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:10219:x1873176368801792:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400482.198582:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400482.198605:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50bf expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.198676:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.198690:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400482.198701:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.208660:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.208790:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.209569:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.210286:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a53c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.210297:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a53c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.210305:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a53c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400482.210316:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1786400482.210929:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.210938:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.210945:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.210951:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400482.210955:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.210963:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.210988:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93739128de00) 00010000:00010000:3.0:1786400482.210990:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400482.210995:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.211001:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a53b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.211015:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.211021:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.211028:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.211032:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400482.211035:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.211041:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.211049:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93739128d100) 00010000:00010000:3.0:1786400482.211051:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400482.211054:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.211060:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a53be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.212312:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a53b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50bf expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.212334:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a53c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50bf expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400482.212342:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:3.0:1786400482.212344:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400482.212347:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763400, rc 0) 00000100:00100000:3.0:1786400482.212420:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:10219:x1873176368801792:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 13928us (14118us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1786400482.212429:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:2.0:1786400482.218395:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400482.218554:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368801920 00000100:00100000:1.0:1786400482.218565:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368801920 00000100:00100000:1.0:1786400482.221900:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:1.0:1786400482.221926:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:10219:x1873176368801920:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1786400482.222065:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:10219:x1873176368801920:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 152us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400482.222073:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00010000:00010000:0.0:1786400482.450934:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786400482.963349:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1786400483.220335:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392957952:0@lo:400:kworker.0 00000100:00100000:1.0:1786400483.220433:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400483.220480:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392958464:0@lo:400:kworker.0 00000100:00100000:1.0:1786400483.220508:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400483.220535:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786400483.220541:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392958080:0@lo:400:kworker.0 00000100:00100000:1.0:1786400483.220561:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400483.220580:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392958592:0@lo:400:kworker.0 00000100:00100000:1.0:1786400483.220618:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400483.220654:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392958464 00000100:00100000:1.0:1786400483.220664:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392958464 00000100:00100000:1.0:1786400483.220727:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392958080 00000100:00100000:1.0:1786400483.220731:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392958080 00000100:00100000:1.0:1786400483.220783:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1786400483.220793:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392958464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400483.220849:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392958464:12345-0@lo:400:kworker.0 Request processed in 57us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400483.220857:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1786400483.220873:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1786400483.220879:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392958080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400483.220902:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392958080:12345-0@lo:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400483.220908:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1786400483.220926:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400483.220960:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392958080:0@lo:400:kworker.0 00000100:00100000:1.0:1786400483.220971:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392958464:0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221157:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392958336:0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221191:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400483.221222:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400483.221236:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392958208:0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221258:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400483.221284:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392957952 00000100:00100000:0.0:1786400483.221288:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392957952 00000100:00100000:0.0:1786400483.221313:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1786400483.221319:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392957952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221354:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392957952:12345-0@lo:400:kworker.0 Request processed in 34us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400483.221360:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1786400483.221388:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392958592 00000100:00100000:0.0:1786400483.221391:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392958592 00000100:00100000:0.0:1786400483.221418:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392958336 00000100:00100000:0.0:1786400483.221420:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392958336 00000100:00100000:0.0:1786400483.221456:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786400483.221463:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392958592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221494:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392958592:12345-0@lo:400:kworker.0 Request processed in 32us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400483.221500:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786400483.221510:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786400483.221516:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392958336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221546:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392958336:12345-0@lo:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400483.221552:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786400483.221568:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392958208 00000100:00100000:0.0:1786400483.221572:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392958208 00000100:00100000:0.0:1786400483.221596:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1786400483.221602:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392958208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221641:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392958208:12345-0@lo:400:kworker.0 Request processed in 38us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400483.221647:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1786400483.221695:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400483.221700:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786400483.221702:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400483.221721:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392958208:0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221731:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392958336:0@lo:400:kworker.0 00010000:00080000:0.0:1786400483.221787:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373987f3480 x1873176392958592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400483.221798:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392958592:0@lo:400:kworker.0 00000100:00100000:0.0:1786400483.221808:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392957952:0@lo:400:kworker.0 00010000:00010000:1.0:1786400483.478952:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400483.736385:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392958720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400483.736469:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400483.736585:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392958720 00000100:00100000:3.0:1786400483.736592:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392958720 00000100:00100000:3.0:1786400483.736646:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786400483.736655:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392958720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400483.736700:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400483.736982:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392958720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 327us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400483.736990:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1786400483.737054:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373afe46300 x1873176392958720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400483.737073:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392958720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786400484.500912:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400484.644440:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400484.645165:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400484.645207:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400484.651508:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368802048 00000100:00100000:3.0:1786400484.651522:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368802048 00000100:00100000:3.0:1786400484.651582:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 290 00000100:00100000:3.0:1786400484.651592:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368802048:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400484.651680:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368802048:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 89us (6516us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400484.651690:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 290 00000100:00100000:1.0:1786400484.654831:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368802176 00000100:00100000:1.0:1786400484.654844:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368802176 00000100:00100000:1.0:1786400484.654922:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368802304 00000100:00100000:1.0:1786400484.654926:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368802304 00000100:00100000:1.0:1786400484.654955:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 142 00000100:00100000:1.0:1786400484.654965:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2360:x1873176368802176:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400484.655038:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2360:x1873176368802176:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 74us (10606us total) trans 0 rc 0/0 00000100:00080000:3.0:1786400484.655174:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400484.655209:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 142 00000100:00100000:1.0:1786400484.655228:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 143 00000100:00100000:1.0:1786400484.655235:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368802304:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400484.655262:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368802304:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (10054us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400484.655268:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 143 00000100:00100000:3.0:1786400484.754979:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392958848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400484.755055:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400484.755184:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392958848 00000100:00100000:2.0:1786400484.755192:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392958848 00000100:00100000:2.0:1786400484.755242:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786400484.755252:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392958848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400484.755284:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400484.755326:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392958848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400484.755334:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786400484.755566:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392958848:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1786400484.880152:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1786400485.000861:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.001063:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368802432 00000100:00100000:1.0:1786400485.001073:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368802432 00000100:00100000:1.0:1786400485.001235:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:1.0:1786400485.001247:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:10261:x1873176368802432:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400485.001267:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400485.001287:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a53d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50c6 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001354:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001367:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001378:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001391:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001399:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001418:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001679:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001687:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001694:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001700:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400485.001704:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001712:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001724:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128d500) 00010000:00010000:1.0:1786400485.001727:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400485.001732:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001767:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a53da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001778:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001784:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001796:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001802:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400485.001805:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001812:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001820:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9373850bf500) 00010000:00010000:1.0:1786400485.001823:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400485.001826:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.001832:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.002188:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a53d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50c6 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.002199:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128d500) 00010000:00010000:1.0:1786400485.002202:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400485.002206:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a53d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50c6 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.002216:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf800, rc 0) 00000100:00100000:1.0:1786400485.002282:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:10261:x1873176368802432:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1037us (1440us total) trans 0 rc 301/301 00000100:00100000:1.0:1786400485.002299:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:3.0:1786400485.009226:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400485.009298:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368802688 00000100:00100000:0.0:1786400485.009307:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368802688 00000100:00100000:0.0:1786400485.009367:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:0.0:1786400485.009377:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:10261:x1873176368802688:12345-192.168.201.23@tcp:36:lfs.0 00010000:00010000:0.0:1786400485.009430:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400485.009626:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a538d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50b1 expref: 8 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.009665:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128d500) 00010000:00010000:0.0:1786400485.009677:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400485.010377:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.010391:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.010401:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.010413:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.010419:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.010426:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400485.012087:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1786400485.012101:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.012110:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.012116:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.012122:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400485.012133:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.012140:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.012152:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93739128dc00) 00010000:00010000:0.0:1786400485.012155:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400485.012159:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.012166:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a53e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400485.012182:0:5818:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008058c105 reply state 000000001e212cfa transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400485.012191:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786400485.012295:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:10261:x1873176368802688:12345-192.168.201.23@tcp:36:lfs.0 Request processed in 2917us (3074us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1786400485.012305:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00010000:00010000:0.0:1786400485.016871:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.016887:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.016894:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.016899:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400485.016903:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.016918:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.016933:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93739128d400) 00010000:00010000:0.0:1786400485.016936:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400485.016940:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.016947:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a53ef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400485.176870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.178478:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368802816 00000100:00100000:1.0:1786400485.178494:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368802816 00000100:00100000:1.0:1786400485.178578:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:1.0:1786400485.178589:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:10269:x1873176368802816:12345-192.168.201.23@tcp:101:lctl.0 00010000:00010000:1.0:1786400485.178617:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400485.178644:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a53f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50cd expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.178777:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.178792:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.178803:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400485.178868:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786400485.178872:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400485.178922:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.178947:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a53f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50cd expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.178966:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50cd expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.179328:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:1.0:1786400485.179331:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400485.179335:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe400, rc 0) 00000100:00100000:3.0:1786400485.179821:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:10269:x1873176368802816:12345-192.168.201.23@tcp:101:lctl.0 Request processed in 1231us (2959us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400485.179831:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1786400485.353459:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400485.353586:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368802944 00000100:00100000:2.0:1786400485.353596:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368802944 00000100:00100000:2.0:1786400485.353669:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:2.0:1786400485.353679:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:10276:x1873176368802944:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400485.353699:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400485.353730:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50d4 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.353822:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.353860:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.353873:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.353888:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.353895:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.353902:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354005:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ea00/0x49554f35ff0a5419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354014:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ea00/0x49554f35ff0a5419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354022:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ea00/0x49554f35ff0a5419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400485.354064:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1786400485.354068:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400485.354105:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ea00/0x49554f35ff0a5419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354118:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354135:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354142:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354148:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400485.354153:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354160:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354172:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:2.0:1786400485.354175:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400485.354179:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354186:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a540b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354200:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354206:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354212:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354217:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ec00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400485.354225:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354232:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354240:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff937386801900) 00010000:00010000:2.0:1786400485.354243:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400485.354246:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354252:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5412 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354280:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50d4 expref: 11 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354293:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ea00/0x49554f35ff0a5419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50d4 expref: 10 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.354301:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400485.354303:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786400485.354306:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1ea00, rc 0) 00000100:00100000:2.0:1786400485.354365:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:10276:x1873176368802944:12345-192.168.201.23@tcp:101:bash.0 Request processed in 687us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400485.354373:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:2.0:1786400485.364923:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.365024:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368803200 00000100:00100000:1.0:1786400485.365042:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368803200 00000100:00100000:1.0:1786400485.365101:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:1.0:1786400485.365110:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:10276:x1873176368803200:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1786400485.365132:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400485.365152:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5420 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.365287:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.365303:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.365315:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.365369:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.365377:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.365384:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400485.366010:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1786400485.366167:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366178:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366186:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366217:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366224:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366231:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366238:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400485.366242:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366249:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366260:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:1.0:1786400485.366263:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400485.366268:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366284:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5427 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400485.366297:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095f0415a reply state 0000000099939176 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400485.366305:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786400485.366335:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5420 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366348:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.366355:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373850bf600) 00010000:00010000:1.0:1786400485.366357:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400485.366359:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe200, rc 0) 00000100:00100000:1.0:1786400485.366434:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:10276:x1873176368803200:12345-192.168.201.23@tcp:101:bash.0 Request processed in 1325us (1520us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1786400485.366442:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00010000:00010000:2.0:1786400485.370997:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.371029:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.371038:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.371044:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfe00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400485.371049:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.371057:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.371074:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9373850bfb00) 00010000:00010000:2.0:1786400485.371077:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400485.371081:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.371088:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a542e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400485.382596:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400485.382712:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368803328 00000100:00100000:0.0:1786400485.382722:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368803328 00000100:00100000:0.0:1786400485.382805:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:0.0:1786400485.382814:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873176368803328:12345-192.168.201.23@tcp:8:bash.0 00010000:00080000:0.0:1786400485.382847:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:0.0:1786400485.382874:0:6622:0:(genops.c:1406:class_connect()) connect: client 2e546c9b-fa03-4565-a5c8-6992a70a28db, cookie 0x49554f35ff0a5443 00002000:00100000:0.0:1786400485.382887:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e546c9b-fa03-4565-a5c8-6992a70a28db/ffff937399733800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786400485.382910:0:6622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786400485.383130:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786400485.383157:0:6622:0:(import.c:65:import_set_state_nolock()) ffff937399734000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400485.383236:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2358:x1873176368803328:12345-192.168.201.23@tcp:8:bash.0 Request processed in 422us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400485.383244:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:3.0:1786400485.386380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400485.386563:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368803456 00000100:00100000:0.0:1786400485.386574:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368803456 00000100:00100000:0.0:1786400485.386656:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:0.0:1786400485.386681:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:0:x1873176368803456:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400485.386699:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400485.386732:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50e2 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786400485.386784:0:6624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786400485.386801:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1786400485.386806:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400485.386815:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 7 pid: 6624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.386836:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 7 pid: 6624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.386849:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031600, rc 0) 00000100:00100000:0.0:1786400485.386910:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:0:x1873176368803456:12345-192.168.201.23@tcp:101:bash.0 Request processed in 231us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400485.386918:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00080000:3.0:1786400485.387334:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400485.393301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400485.395015:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368803584 00000100:00100000:0.0:1786400485.395028:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368803584 00000100:00100000:0.0:1786400485.395090:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1786400485.395100:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:10276:x1873176368803584:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400485.395119:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400485.395138:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50e9 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.395197:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 8 pid: 6624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.395206:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400485.395210:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400485.395215:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.395250:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 8 pid: 6624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.395263:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 8 pid: 6624 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400485.395277:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6622:1873176392958976:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400485.395378:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738da54780 going to sleep for 11 seconds 00000100:00100000:2.0:1786400485.404023:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.404274:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368803712 00000100:00100000:1.0:1786400485.404283:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368803712 00010000:00010000:1.0:1786400485.404323:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 9 pid: 6624 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400485.404361:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:1.0:1786400485.404371:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2362:x1873176368803712:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400485.404386:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400485.404422:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 9 pid: 6624 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.404438:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 9 pid: 6624 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.404471:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400485.404476:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400485.404485:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.404495:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.404532:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400485.404546:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5800:1873176392959104:192.168.201.23@tcp:105: 00000100:00100000:1.0:1786400485.404632:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372240 going to sleep for 11 seconds 00000100:00100000:1.0:1786400485.406409:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5800:1873176392959104:192.168.201.23@tcp:105: 00010000:00010000:1.0:1786400485.406429:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400485.406471:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2362:x1873176368803712:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 2101us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400485.406480:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00010000:00010000:0.0:1786400485.406904:0:6622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000901e69a6/0x49554f35ff0a544a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e2 expref: 8 pid: 6624 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400485.406921:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6622:1873176392958976:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400485.406940:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 7 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.406952:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031e00, rc 0) 00000100:00100000:0.0:1786400485.407000:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:10276:x1873176368803584:12345-192.168.201.23@tcp:101:bash.0 Request processed in 11901us (13708us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400485.407007:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:2.0:1786400485.409882:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400485.409959:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368803968 00000100:00100000:3.0:1786400485.409968:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368803968 00000100:00100000:3.0:1786400485.410022:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1786400485.410032:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:10276:x1873176368803968:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:3.0:1786400485.410392:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:10276:x1873176368803968:12345-192.168.201.23@tcp:35:bash.0 Request processed in 360us (518us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1786400485.410400:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00010000:00010000:1.0:1786400485.522910:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400485.552320:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400485.552422:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368804224 00000100:00100000:0.0:1786400485.552432:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368804224 00000100:00100000:0.0:1786400485.552490:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:0.0:1786400485.552500:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:10286:x1873176368804224:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400485.552523:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400485.552543:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400485.552659:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1786400485.552813:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5458 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50f0 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.552828:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:0.0:1786400485.552831:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400485.552836:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50f0 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.552850:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031600, rc 0) 00000100:00100000:0.0:1786400485.552913:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:10286:x1873176368804224:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 414us (601us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1786400485.552921:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:0.0:1786400485.574021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400485.574133:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368804480 00000100:00100000:3.0:1786400485.574145:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368804480 00000100:00100000:3.0:1786400485.574216:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1786400485.574227:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:10286:x1873176368804480:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400485.574512:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:10286:x1873176368804480:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 287us (500us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1786400485.574519:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1786400485.669727:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.670360:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368804608 00000100:00100000:1.0:1786400485.670385:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368804608 00000100:00100000:1.0:1786400485.670446:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:1.0:1786400485.670458:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:10292:x1873176368804608:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400485.670680:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400485.670704:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.670814:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a546d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.671363:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a546d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.671378:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a546d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400485.671438:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1786400485.671442:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400485.671470:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a546d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.671511:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50f7 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.671529:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a546d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50f7 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.671537:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:1.0:1786400485.671540:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400485.671544:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf600, rc 0) 00000100:00100000:1.0:1786400485.672364:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:10292:x1873176368804608:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1904us (2642us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400485.672373:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:0.0:1786400485.690521:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400485.692677:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368804864 00000100:00100000:2.0:1786400485.692690:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368804864 00000100:00100000:2.0:1786400485.692804:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:2.0:1786400485.692815:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:10292:x1873176368804864:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400485.692855:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400485.692876:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f50fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.692976:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a547b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.692991:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.693003:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400485.693014:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1786400485.693885:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50fe expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.693908:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a547b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50fe expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.693917:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373850bf600) 00010000:00010000:2.0:1786400485.693920:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400485.693924:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f800, rc 0) 00000100:00100000:2.0:1786400485.694036:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:10292:x1873176368804864:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1223us (3523us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1786400485.694045:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:0.0:1786400485.706810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.707212:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368804992 00000100:00100000:1.0:1786400485.707223:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368804992 00000100:00100000:1.0:1786400485.707553:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1786400485.707565:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:2361:x1873176368804992:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400485.707581:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400485.707914:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a547b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50fe expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.707935:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373850bf600) 00010000:00010000:1.0:1786400485.707940:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400485.708034:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:2361:x1873176368804992:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 471us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400485.708041:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:0.0:1786400485.711585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.712857:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368805248 00000100:00100000:1.0:1786400485.712869:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368805248 00000100:00100000:1.0:1786400485.712934:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1786400485.712945:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:10292:x1873176368805248:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400485.712970:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400485.712992:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5105 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.713088:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5490 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.713103:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.713126:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400485.713139:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1786400485.713937:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5105 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.713957:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5105 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.713966:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373850bf600) 00010000:00010000:1.0:1786400485.713968:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786400485.713972:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf400, rc 0) 00000100:00100000:1.0:1786400485.714030:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:10292:x1873176368805248:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1087us (2453us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1786400485.714036:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:0.0:1786400485.726849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.726955:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368805376 00000100:00100000:1.0:1786400485.726965:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368805376 00000100:00100000:1.0:1786400485.727011:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:1.0:1786400485.727021:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368805376:12345-192.168.201.23@tcp:1:lfs.0 00010000:00010000:1.0:1786400485.727064:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.727084:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 7 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.727093:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400485.727104:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400485.727109:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.727144:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 7 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.727158:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 7 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400485.727173:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6624:1873176392959232:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400485.727263:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372240 going to sleep for 11 seconds 00000100:00100000:1.0:1786400485.729332:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6624:1873176392959232:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400485.729357:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400485.733961:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.734068:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368805504 00000100:00100000:1.0:1786400485.734078:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368805504 00002000:00100000:1.0:1786400485.734123:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9373c017f800 x1873176368805504/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:281/0 lens 504/0 e 0 to 0 dl 1786400496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400485.734134:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373c017f800 with x1873176368805504 ext(0->12) 00010000:00010000:1.0:1786400485.734143:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 8 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.734172:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 8 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400485.734198:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9373c017f800 00000100:00100000:1.0:1786400485.734231:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1786400485.734240:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368805504:12345-192.168.201.23@tcp:4:lfs.0 00000001:00100000:2.0:1786400485.847002:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000100:00100000:1.0:1786400485.847857:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2362:x1873176368805504:12345-192.168.201.23@tcp:4:lfs.0 Request processed in 113612us (113900us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1786400485.847870:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00002000:00100000:1.0:1786400485.847882:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9373c017f800 x1873176368805504/t4294967299(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:281/0 lens 504/448 e 0 to 0 dl 1786400496 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400485.847893:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373c017f800 with x1873176368805504 ext(0->12) 00010000:00010000:1.0:1786400485.847904:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.847921:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400485.847929:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9373c017f800 00000100:00100000:0.0:1786400485.850571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.850779:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368805632 00000100:00100000:1.0:1786400485.850789:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368805632 00010000:00010000:1.0:1786400485.850827:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400485.851314:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:1.0:1786400485.851325:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2362:x1873176368805632:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400485.851356:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786400485.851375:0:5800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1786400485.851378:0:5800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1786400485 00002000:00010000:1.0:1786400485.851381:0:5800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1786400485 00002000:00010000:1.0:1786400485.851384:0:5800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1786400485 00010000:00010000:1.0:1786400485.851390:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.851404:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.851439:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5451 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50e9 expref: 9 pid: 6622 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.851457:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400485.851461:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400485.851467:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.851477:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.851510:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400485.851561:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368805632:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 238us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400485.851569:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00010000:00010000:0.0:1786400485.851628:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.851638:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.851693:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.851712:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.851720:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.851727:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400485.851732:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.851765:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.851777:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400485.851792:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a03718b/0x49554f35ff0a549e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400485.851837:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368805376:12345-192.168.201.23@tcp:1:lfs.0 Request processed in 124817us (124997us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400485.851858:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:0.0:1786400485.863328:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400485.866842:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368805888 00000100:00100000:3.0:1786400485.866854:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368805888 00000100:00100000:3.0:1786400485.866916:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1786400485.866926:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:10292:x1873176368805888:12345-192.168.201.23@tcp:35:lfs.0 00000004:00010000:3.0:1786400485.866988:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5105 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786400485.867246:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1786400485.867289:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1786400485.868038:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1786400485.868088:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400485.868103:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400485.868112:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400485.868197:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400485.868224:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 23 pid: 5816 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400485.868239:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5819:1873176392959360:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400485.868465:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373911689c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400485.879858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400485.879982:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368806016 00000100:00100000:1.0:1786400485.879992:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368806016 00010000:00010000:1.0:1786400485.880034:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 24 pid: 5816 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400485.880078:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:1.0:1786400485.880089:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:2361:x1873176368806016:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400485.880103:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400485.880121:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 24 pid: 5816 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.880136:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 24 pid: 5816 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.880166:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373850bf600) 00010000:00010000:1.0:1786400485.880172:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.880183:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.880190:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.880208:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400485.880257:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:2361:x1873176368806016:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 170us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400485.880266:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00010000:00010000:3.0:1786400485.880517:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50db expref: 23 pid: 5816 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400485.880535:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5819:1873176392959360:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400485.880567:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400485.880575:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400485.880582:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786400485.881047:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1786400485.881255:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1786400485.881367:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1873176392959488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786400485.881419:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400485.881454:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set ffff937391168840 going to sleep for 11 seconds 00000100:00100000:1.0:1786400485.881575:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392959488 00000100:00100000:1.0:1786400485.881587:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392959488 00000100:00100000:1.0:1786400485.881635:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400485.881655:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1873176392959488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786400485.881720:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1873176392959488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400485.881728:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400485.881791:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1873176392959488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1786400485.882372:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1786400485.882424:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1873176392959616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786400485.882462:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400485.882486:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392959616 00000100:00100000:1.0:1786400485.882491:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392959616 00000100:00100000:1.0:1786400485.882509:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400485.882515:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1873176392959616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786400485.882628:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5819:x1873176392959616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 112us (164us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1786400485.882635:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400485.882670:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400485.882687:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1873176392959616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1786400485.882719:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1786400485.882768:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.882778:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.882784:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.882798:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400485.882802:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.882809:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.882824:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373850bf600) 00010000:00010000:1.0:1786400485.882827:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786400485.882831:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400485.882838:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a54a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400485.882978:0:5819:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1786400485.883156:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1786400485.883167:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407624427792ns, next at 408624425431ns, rc = 0 00000001:00080000:1.0:1786400485.883173:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1786400485.883202:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373850bf600) 00010000:00010000:1.0:1786400485.883206:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786400485.883212:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5490 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5105 expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400485.883293:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:10292:x1873176368805888:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 16368us (19974us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1786400485.883302:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000020:00080000:1.0:1786400485.883306:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1786400485.883827:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400485.895332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400485.895445:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368806144 00000100:00100000:2.0:1786400485.895455:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368806144 00000100:00100000:2.0:1786400485.895530:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:2.0:1786400485.895540:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:10292:x1873176368806144:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400485.895573:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400485.895596:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a54ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f510c expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.895665:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a54ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f510c expref: 27 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.895681:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a54ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f510c expref: 27 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400485.895709:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400485.895712:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400485.895716:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e600, rc 0) 00000100:00100000:1.0:1786400485.902799:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:10292:x1873176368806144:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 7249us (7465us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400485.902812:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:1.0:1786400485.905995:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400485.906083:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368806400 00000100:00100000:2.0:1786400485.906093:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368806400 00000100:00100000:2.0:1786400485.906166:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:2.0:1786400485.906178:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739026a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:10292:x1873176368806400:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400485.906610:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739026a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+28:10292:x1873176368806400:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 432us (622us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1786400485.906618:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:2.0:1786400486.036412:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400486.036478:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368806656 00000100:00100000:1.0:1786400486.036489:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368806656 00000100:00100000:1.0:1786400486.036566:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:1.0:1786400486.036577:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+28:10301:x1873176368806656:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400486.036601:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400486.036621:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a54b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5113 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786400486.036800:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1786400486.036821:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786400486.036950:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a54b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5113 expref: 30 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.036963:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:1.0:1786400486.036966:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400486.036970:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a54b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5113 expref: 30 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.036983:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf400, rc 0) 00000100:00100000:1.0:1786400486.037035:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:10301:x1873176368806656:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 461us (633us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1786400486.037042:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:3.0:1786400486.064384:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400486.064503:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368806784 00000100:00100000:0.0:1786400486.064514:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368806784 00000100:00100000:0.0:1786400486.064576:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:0.0:1786400486.064586:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:10301:x1873176368806784:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:0.0:1786400486.064673:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064689:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064708:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064723:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064729:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064778:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064887:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064895:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064902:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400486.064944:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064958:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064965:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064972:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064978:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400486.064983:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.064990:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065002:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400486.065011:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400486.065016:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065022:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a54c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065035:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065041:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065048:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065054:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400486.065057:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065063:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065071:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93739128d400) 00010000:00010000:0.0:1786400486.065074:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400486.065077:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065083:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065097:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065108:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065114:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065119:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400486.065122:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065128:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065136:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:0.0:1786400486.065138:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400486.065142:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.065147:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a54cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400486.065221:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:10301:x1873176368806784:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 636us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400486.065231:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:0.0:1786400486.068220:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400486.068347:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368807040 00000100:00100000:2.0:1786400486.068356:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368807040 00000100:00100000:2.0:1786400486.068413:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1786400486.068432:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:10301:x1873176368807040:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400486.068716:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:10301:x1873176368807040:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 292us (504us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1786400486.068724:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1786400486.130039:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400486.130137:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368807296 00000100:00100000:1.0:1786400486.130156:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368807296 00000100:00100000:1.0:1786400486.130215:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:1.0:1786400486.130235:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:10305:x1873176368807296:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400486.130259:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400486.130280:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a54d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f511a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130372:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130386:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130398:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130413:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130420:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130427:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130552:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130560:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130567:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400486.130586:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1786400486.130693:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130702:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130709:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130715:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400486.130719:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130727:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130790:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:1.0:1786400486.130794:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400486.130799:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130805:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a54dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130820:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130826:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130842:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130846:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebea00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400486.130849:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130856:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130864:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9373850bf600) 00010000:00010000:1.0:1786400486.130867:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400486.130869:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130875:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a54e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130914:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a54d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130928:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.130936:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400486.130938:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400486.130940:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf000, rc 0) 00000100:00100000:1.0:1786400486.130994:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:10305:x1873176368807296:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 759us (964us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1786400486.131015:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:3.0:1786400486.139213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400486.139372:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368807424 00000100:00100000:0.0:1786400486.139383:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368807424 00000100:00100000:0.0:1786400486.139447:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1786400486.139456:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:10305:x1873176368807424:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:0.0:1786400486.139531:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139549:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139561:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139590:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139597:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139605:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139612:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400486.139617:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139625:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139669:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:0.0:1786400486.139673:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400486.139678:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400486.139684:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a54f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400486.139823:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:10305:x1873176368807424:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 367us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400486.139831:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1786400486.151866:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400486.151961:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368807680 00000100:00100000:2.0:1786400486.151970:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368807680 00000100:00100000:2.0:1786400486.152031:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1786400486.152041:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:10305:x1873176368807680:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400486.152307:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+33:10305:x1873176368807680:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 266us (448us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1786400486.152316:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00010000:00010000:2.0:1786400486.547198:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400486.638259:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400486.638790:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368807936 00000100:00100000:1.0:1786400486.638801:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368807936 00000100:00100000:1.0:1786400486.638871:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:1.0:1786400486.638880:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+33:10335:x1873176368807936:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:1.0:1786400486.638904:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400486.638923:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5500 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5121 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.639013:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5507 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.639028:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.639203:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400486.639218:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1786400486.639385:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5500 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5121 expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.639406:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5121 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.639415:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400486.639418:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400486.639422:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebea00, rc 0) 00000100:00100000:1.0:1786400486.639501:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:10335:x1873176368807936:12345-192.168.201.23@tcp:101:cat.0 Request processed in 622us (1251us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1786400486.639509:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:3.0:1786400486.644257:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400486.644412:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400486.645401:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368808320 00000100:00100000:1.0:1786400486.645412:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368808320 00000100:00100000:1.0:1786400486.645487:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:1.0:1786400486.645498:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:2362:x1873176368808320:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400486.645513:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400486.645539:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5507 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5121 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.645559:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400486.645564:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400486.645618:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:2362:x1873176368808320:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 122us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400486.645641:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1786400486.661408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368808192 00000100:00100000:2.0:1786400486.661424:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368808192 00000100:00100000:3.0:1786400486.662207:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:3.0:1786400486.662219:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:10335:x1873176368808192:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:3.0:1786400486.662504:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:10335:x1873176368808192:12345-192.168.201.23@tcp:35:cat.0 Request processed in 286us (18255us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1786400486.662513:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:0.0:1786400486.767698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400486.767830:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368808576 00000100:00100000:1.0:1786400486.767850:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368808576 00000100:00100000:1.0:1786400486.767908:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:1.0:1786400486.767917:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:10342:x1873176368808576:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:1.0:1786400486.767941:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400486.767944:0:8098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786400486.767971:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a546d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50f7 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.767991:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:1.0:1786400486.767995:0:8098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400486.768023:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5515 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5128 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.768127:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.768150:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.768159:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.768193:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.768206:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 35 pid: 5817 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400486.768220:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392959744:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400486.768312:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400486.775460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400486.775598:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368808704 00000100:00100000:3.0:1786400486.775616:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368808704 00010000:00010000:3.0:1786400486.775689:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 36 pid: 5817 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400486.775769:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1786400486.775786:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+36:2362:x1873176368808704:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400486.775811:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400486.775824:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 36 pid: 5817 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400486.775842:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 36 pid: 5817 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400486.775867:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:3.0:1786400486.775872:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400486.775882:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400486.775904:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400486.775938:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400486.776025:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+36:2362:x1873176368808704:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 241us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400486.776037:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00010000:00010000:1.0:1786400486.781512:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a54eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f511a expref: 35 pid: 5817 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400486.781541:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392959744:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400486.781568:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.781578:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.781608:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400486.781648:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1786400486.781854:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5515 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 36 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.781870:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 35 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.781880:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400486.781883:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786400486.781886:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf400, rc 0) 00000100:00100000:1.0:1786400486.781962:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:10342:x1873176368808576:12345-192.168.201.23@tcp:101:dd.0 Request processed in 14045us (14284us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1786400486.781971:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:0.0:1786400486.784884:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400486.785038:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368808960 00000100:00100000:2.0:1786400486.785047:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368808960 00000100:00100000:2.0:1786400486.785111:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:2.0:1786400486.785121:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:10342:x1873176368808960:12345-192.168.201.23@tcp:36:dd.0 00010000:00010000:2.0:1786400486.785380:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400486.785396:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400486.785407:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400486.785455:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1786400486.785500:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c6887a72 reply state 00000000a8583bdc transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400486.785508:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400486.785603:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:10342:x1873176368808960:12345-192.168.201.23@tcp:36:dd.0 Request processed in 482us (729us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1786400486.785610:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00000020:00080000:2.0:1786400486.785616:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400486.787227:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.787242:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.787250:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.787257:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fc00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400486.787261:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.787284:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.787298:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400486.787301:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400486.787306:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400486.787312:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a552a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400487.207030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400487.207461:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368809088 00000100:00100000:2.0:1786400487.207472:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368809088 00000100:00100000:2.0:1786400487.207539:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:2.0:1786400487.207549:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:10356:x1873176368809088:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:2.0:1786400487.207572:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400487.207591:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5531 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f512f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207667:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207691:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207703:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207717:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207724:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207782:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207875:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207887:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 38 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207896:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.207935:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 38 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.208204:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 38 pid: 8098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400487.208221:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392959872:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400487.208319:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738783b600 going to sleep for 11 seconds 00000100:00100000:0.0:1786400487.217211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400487.218192:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368809344 00000100:00100000:3.0:1786400487.218205:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368809344 00000100:00100000:3.0:1786400487.218276:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:3.0:1786400487.218286:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:5577:x1873176368809344:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786400487.218638:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:5577:x1873176368809344:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 352us (1436us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1786400487.218647:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1786400487.219689:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392959872:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400487.219716:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400487.223350:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400487.223637:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368809472 00000100:00100000:0.0:1786400487.223647:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368809472 00010000:00010000:0.0:1786400487.223700:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 40 pid: 8098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400487.223780:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:0.0:1786400487.223790:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:2362:x1873176368809472:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400487.223805:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400487.223811:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 40 pid: 8098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.223824:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 40 pid: 8098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.223845:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a551c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5128 expref: 40 pid: 8098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.223877:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:0.0:1786400487.223882:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.223892:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.223900:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.223927:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400487.224046:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:2362:x1873176368809472:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 257us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400487.224054:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00010000:00010000:2.0:1786400487.226798:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.226816:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400487.226892:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1786400487.226897:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400487.226941:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.226967:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.226978:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.226986:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.226994:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227000:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400487.227005:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227012:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227027:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400487.227030:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400487.227034:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227041:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5538 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227067:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227073:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227080:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227085:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400487.227093:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227100:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227108:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff937386801900) 00010000:00010000:2.0:1786400487.227110:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400487.227113:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227120:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a553f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227163:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5531 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f512f expref: 39 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227177:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f512f expref: 38 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.227197:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400487.227199:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400487.227202:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fe00, rc 0) 00000100:00100000:2.0:1786400487.227259:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:10356:x1873176368809088:12345-192.168.201.23@tcp:101:stat.0 Request processed in 19711us (20239us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400487.227268:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:0.0:1786400487.379206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400487.379310:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368809728 00000100:00100000:2.0:1786400487.379320:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368809728 00000100:00100000:2.0:1786400487.379406:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:2.0:1786400487.379417:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:10362:x1873176368809728:12345-192.168.201.23@tcp:36:truncate.0 00010000:00010000:2.0:1786400487.379480:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400487.379508:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f512f expref: 38 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.379528:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400487.379533:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400487.379837:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.379863:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.379873:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400487.379927:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1786400487.379953:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f7fc1db reply state 000000008a773ba3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400487.379975:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400487.380085:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:10362:x1873176368809728:12345-192.168.201.23@tcp:36:truncate.0 Request processed in 670us (888us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1786400487.380094:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 54 00000020:00080000:2.0:1786400487.380099:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786400487.396377:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.396400:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.396409:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.396415:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ee00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400487.396419:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.396427:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.396446:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400487.396449:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400487.396454:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.396460:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a554d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.571023:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400487.642554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400487.642671:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368809856 00000100:00100000:0.0:1786400487.642681:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368809856 00000100:00100000:0.0:1786400487.642768:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:0.0:1786400487.642779:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:10376:x1873176368809856:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:0.0:1786400487.642802:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400487.642822:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5136 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.642902:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.642915:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.642945:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.642960:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.642968:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.642975:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643065:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643074:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643278:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400487.643315:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1786400487.643319:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400487.643342:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643355:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643363:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643380:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643386:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643393:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400487.643398:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643406:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643418:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400487.643421:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400487.643426:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643431:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a555b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643446:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643453:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643459:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643464:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400487.643473:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643480:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643488:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93739128d400) 00010000:00010000:0.0:1786400487.643490:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400487.643493:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643500:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643530:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 41 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643542:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 40 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400487.643550:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:0.0:1786400487.643552:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400487.643555:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031600, rc 0) 00000100:00100000:0.0:1786400487.643626:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:10376:x1873176368809856:12345-192.168.201.23@tcp:101:stat.0 Request processed in 848us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400487.643634:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:3.0:1786400487.815908:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400487.816041:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368810112 00000100:00100000:2.0:1786400487.816064:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368810112 00000100:00100000:2.0:1786400487.816142:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:2.0:1786400487.816152:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:10386:x1873176368810112:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400487.816174:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400487.816196:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f513d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400487.816310:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1786400487.816458:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5570 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f513d expref: 42 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.816472:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:2.0:1786400487.816475:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400487.816480:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f513d expref: 42 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.816495:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1ee00, rc 0) 00000100:00100000:2.0:1786400487.816562:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+41:10386:x1873176368810112:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 411us (663us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1786400487.816569:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:3.0:1786400487.820125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400487.820230:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368810368 00000100:00100000:0.0:1786400487.820239:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368810368 00000100:00100000:0.0:1786400487.820299:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1786400487.820309:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+41:10386:x1873176368810368:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1786400487.820581:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+42:10386:x1873176368810368:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 273us (475us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1786400487.820591:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1786400487.937879:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400487.937987:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368810624 00000100:00100000:1.0:1786400487.937997:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368810624 00000100:00100000:1.0:1786400487.938057:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:1.0:1786400487.938067:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+42:10392:x1873176368810624:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1786400487.938100:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400487.938130:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a557e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5144 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.938226:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.938242:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 43 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.938251:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.938302:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 43 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.938316:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 43 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400487.938329:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392960000:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400487.938442:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372840 going to sleep for 11 seconds 00000100:00100000:1.0:1786400487.944437:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392960000:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400487.944470:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400487.948612:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400487.949207:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368810752 00000100:00100000:1.0:1786400487.949216:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368810752 00010000:00010000:1.0:1786400487.949258:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 44 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400487.949300:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:1.0:1786400487.949309:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+44:2362:x1873176368810752:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400487.949324:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400487.949331:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 44 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.949343:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 44 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.949387:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5136 expref: 44 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.949416:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400487.949421:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.949432:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.949440:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.949472:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400487.949526:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:2362:x1873176368810752:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 218us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400487.949535:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00010000:00010000:2.0:1786400487.949612:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.949621:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400487.949642:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1786400487.949841:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a557e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 44 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.949868:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 43 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.949876:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400487.949880:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786400487.949882:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf600, rc 0) 00000100:00100000:2.0:1786400487.949907:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:10392:x1873176368810624:12345-192.168.201.23@tcp:101:bash.0 Request processed in 11842us (12039us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1786400487.949914:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:3.0:1786400487.956917:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400487.957016:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368811008 00000100:00100000:2.0:1786400487.957025:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368811008 00000100:00100000:2.0:1786400487.957093:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:2.0:1786400487.957103:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:10392:x1873176368811008:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:2.0:1786400487.957377:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.957405:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.957417:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400487.957465:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1786400487.957490:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000366c1f22 reply state 00000000e4b6686d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400487.957500:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400487.957615:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+46:10392:x1873176368811008:12345-192.168.201.23@tcp:36:bash.0 Request processed in 503us (697us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1786400487.957622:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00000020:00080000:2.0:1786400487.957628:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400487.968227:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.968246:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.968255:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.968261:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ee00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400487.968266:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.968294:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.968313:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400487.968316:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400487.968321:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400487.968328:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5593 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400487.990370:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400487.990671:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368811136 00000100:00100000:2.0:1786400487.990682:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368811136 00000100:00100000:2.0:1786400487.990787:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:2.0:1786400487.990798:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:10392:x1873176368811136:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400487.990824:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400487.990844:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a559a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f514b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.990925:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.990940:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 46 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.990948:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.990982:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 46 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400487.990996:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 46 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400487.991011:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392960128:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400487.991097:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738783bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400487.999093:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392960128:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400487.999133:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400487.999365:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400488.000116:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368811264 00000100:00100000:0.0:1786400488.000123:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368811264 00010000:00010000:0.0:1786400488.000162:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 47 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400488.000205:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:0.0:1786400488.000215:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:2361:x1873176368811264:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400488.000230:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400488.000237:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 47 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.000249:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 47 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.000272:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5585 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5144 expref: 47 pid: 8098 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.000289:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:0.0:1786400488.000294:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.000305:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.000326:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.000357:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400488.000411:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+46:2361:x1873176368811264:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 197us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400488.000420:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00010000:00010000:2.0:1786400488.001318:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.001329:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400488.001373:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1786400488.001378:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400488.001462:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.001498:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a559a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f514b expref: 46 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.001515:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f514b expref: 45 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.001523:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400488.001526:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400488.001529:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f400, rc 0) 00000100:00100000:2.0:1786400488.001624:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:10392:x1873176368811136:12345-192.168.201.23@tcp:101:bash.0 Request processed in 10827us (11263us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400488.001632:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:3.0:1786400488.008363:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400488.009799:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368811520 00000100:00100000:1.0:1786400488.009812:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368811520 00000100:00080000:3.0:1786400488.009868:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400488.009928:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:1.0:1786400488.009940:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390268050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:10392:x1873176368811520:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:1.0:1786400488.010181:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390268050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+46:10392:x1873176368811520:12345-192.168.201.23@tcp:35:bash.0 Request processed in 243us (1826us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1786400488.010189:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00000040:00080000:3.0:1786400488.083336:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1786400488.130678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400488.130819:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368811776 00000100:00100000:2.0:1786400488.130831:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368811776 00000100:00100000:2.0:1786400488.130900:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:2.0:1786400488.130925:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+46:10402:x1873176368811776:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400488.130963:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400488.130984:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a55a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5152 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400488.131111:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1786400488.131244:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a55a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5152 expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.131259:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:2.0:1786400488.131262:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400488.131268:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a55a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5152 expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.131283:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fe00, rc 0) 00000100:00100000:2.0:1786400488.131347:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:10402:x1873176368811776:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 424us (687us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1786400488.131355:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:3.0:1786400488.143856:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400488.143968:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368811904 00000100:00100000:1.0:1786400488.143979:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368811904 00000100:00100000:1.0:1786400488.144039:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:1.0:1786400488.144049:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:10402:x1873176368811904:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:1.0:1786400488.144137:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144154:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144183:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144200:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144207:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144213:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144312:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144322:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144329:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400488.144369:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144382:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144390:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144397:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144413:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400488.144418:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144425:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144438:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:1.0:1786400488.144441:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400488.144446:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144452:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144466:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144473:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144480:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144485:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400488.144488:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144494:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144514:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9373850bf600) 00010000:00010000:1.0:1786400488.144516:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400488.144519:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144526:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144541:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144548:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144554:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144560:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400488.144563:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144570:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144577:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400488.144579:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400488.144582:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.144588:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400488.144682:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:10402:x1873176368811904:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 633us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400488.144690:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:0.0:1786400488.147694:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400488.147810:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368812160 00000100:00100000:2.0:1786400488.147818:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368812160 00000100:00100000:2.0:1786400488.147871:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:2.0:1786400488.147880:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:10402:x1873176368812160:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400488.148129:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+48:10402:x1873176368812160:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 249us (443us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1786400488.148138:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:3.0:1786400488.198643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400488.198770:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368812416 00000100:00100000:1.0:1786400488.198782:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368812416 00000100:00100000:1.0:1786400488.198840:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:1.0:1786400488.198850:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+48:10405:x1873176368812416:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400488.198876:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400488.198898:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5159 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.198970:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.198983:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.198994:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199009:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199017:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199024:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199181:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a55e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199190:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a55e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199197:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a55e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400488.199208:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1786400488.199303:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199310:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199317:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199322:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400488.199327:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199340:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199351:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:1.0:1786400488.199354:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400488.199359:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199376:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a55d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199400:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199407:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199412:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199417:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400488.199420:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199425:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199433:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9373850bf600) 00010000:00010000:1.0:1786400488.199436:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400488.199438:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199445:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a55d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199485:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5159 expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199499:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a55e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5159 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.199513:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400488.199515:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400488.199518:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebea00, rc 0) 00000100:00100000:1.0:1786400488.199582:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:10405:x1873176368812416:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 734us (952us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1786400488.199590:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1786400488.204313:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400488.204368:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400488.204476:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368812672 00000100:00100000:2.0:1786400488.204493:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368812672 00000100:00100000:2.0:1786400488.204557:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:2.0:1786400488.204566:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:2362:x1873176368812672:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400488.204595:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400488.204632:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a55e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5159 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.204652:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400488.204662:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400488.204715:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+49:2362:x1873176368812672:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 150us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400488.204723:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:1.0:1786400488.205674:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368812544 00000100:00100000:1.0:1786400488.205682:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368812544 00000100:00100000:1.0:1786400488.205732:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:1.0:1786400488.205756:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+49:10405:x1873176368812544:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:1.0:1786400488.205819:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205834:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205844:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205871:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205878:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205884:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205890:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400488.205904:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205912:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205923:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400488.205926:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400488.205929:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.205935:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400488.205988:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+49:10405:x1873176368812544:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 249us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400488.205995:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:3.0:1786400488.208826:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400488.208911:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368812928 00000100:00100000:2.0:1786400488.208922:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368812928 00000100:00100000:2.0:1786400488.208973:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1786400488.208983:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+49:10405:x1873176368812928:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400488.209232:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:10405:x1873176368812928:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 250us (414us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1786400488.209241:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1786400488.339018:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392960256:0@lo:400:kworker.0 00000100:00100000:0.0:1786400488.339093:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400488.339161:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392960768:0@lo:400:kworker.0 00000100:00100000:0.0:1786400488.339187:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400488.339211:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786400488.339216:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392960384:0@lo:400:kworker.0 00000100:00100000:0.0:1786400488.339237:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400488.339251:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392960896:0@lo:400:kworker.0 00000100:00100000:0.0:1786400488.339274:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400488.339305:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392960896 00000100:00100000:0.0:1786400488.339313:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392960896 00000100:00100000:0.0:1786400488.339364:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786400488.339373:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392960896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400488.339434:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392960896:12345-0@lo:400:kworker.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400488.339442:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786400488.339484:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392960896:0@lo:400:kworker.0 00000100:00100000:3.0:1786400488.339769:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392960512:0@lo:400:kworker.0 00000100:00100000:3.0:1786400488.339800:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400488.339817:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400488.339823:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392960640:0@lo:400:kworker.0 00000100:00100000:3.0:1786400488.339843:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786400488.339868:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400488.339879:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392960640 00000100:00100000:3.0:1786400488.339883:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392960640 00000100:00100000:3.0:1786400488.339912:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786400488.339919:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392960640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400488.339953:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392960640:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400488.339959:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1786400488.339975:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400488.339990:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392960640:0@lo:400:kworker.0 00000100:00100000:1.0:1786400488.340121:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392960256 00000100:00100000:1.0:1786400488.340126:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392960256 00000100:00100000:1.0:1786400488.340160:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1786400488.340168:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392960256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400488.340204:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392960256:12345-0@lo:400:kworker.0 Request processed in 37us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400488.340211:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1786400488.340237:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392960768 00000100:00100000:1.0:1786400488.340241:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392960768 00000100:00100000:1.0:1786400488.340267:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392960384 00000100:00100000:1.0:1786400488.340270:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392960384 00000100:00100000:1.0:1786400488.340280:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392960512 00000100:00100000:1.0:1786400488.340282:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392960512 00000100:00100000:1.0:1786400488.340296:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1786400488.340309:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392960768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400488.340340:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392960768:12345-0@lo:400:kworker.0 Request processed in 31us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400488.340346:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1786400488.340358:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1786400488.340363:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392960384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400488.340401:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392960384:12345-0@lo:400:kworker.0 Request processed in 37us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400488.340408:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1786400488.340418:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1786400488.340424:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392960512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400488.340452:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392960512:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400488.340459:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1786400488.340671:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400488.340693:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392960512:0@lo:400:kworker.0 00000100:00100000:0.0:1786400488.340853:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392960384:0@lo:400:kworker.0 00000100:00100000:0.0:1786400488.340865:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392960256:0@lo:400:kworker.0 00000100:00100000:0.0:1786400488.340875:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392960768:0@lo:400:kworker.0 00000100:00100000:3.0:1786400488.530276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400488.530526:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368813184 00000100:00100000:1.0:1786400488.530536:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368813184 00000100:00100000:1.0:1786400488.530607:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1786400488.530617:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:10423:x1873176368813184:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:1.0:1786400488.530643:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400488.530672:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5160 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.530827:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.531324:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.531355:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400488.531369:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1786400488.531494:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a55f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5160 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.531514:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5160 expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.531523:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400488.531526:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786400488.531529:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf000, rc 0) 00000100:00100000:1.0:1786400488.531644:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10423:x1873176368813184:12345-192.168.201.23@tcp:101:cat.0 Request processed in 1028us (1376us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1786400488.531661:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00010000:00010000:2.0:1786400488.595002:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400488.599704:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400488.599929:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368813312 00000100:00100000:0.0:1786400488.599941:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368813312 00000100:00100000:0.0:1786400488.600002:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:0.0:1786400488.600013:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10424:x1873176368813312:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400488.600042:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400488.600076:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a560a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5167 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.600309:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.600324:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.600335:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400488.600397:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1786400488.600401:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400488.600424:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.600449:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a560a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5167 expref: 54 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.600482:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5167 expref: 53 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.600491:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400488.600494:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400488.600497:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031c00, rc 0) 00000100:00100000:0.0:1786400488.600560:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10424:x1873176368813312:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 549us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400488.600568:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:0.0:1786400488.613179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400488.613351:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368813696 00000100:00100000:2.0:1786400488.613363:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368813696 00000100:00100000:2.0:1786400488.613427:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:2.0:1786400488.613437:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10424:x1873176368813696:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400488.613793:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10424:x1873176368813696:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 357us (622us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1786400488.613817:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:3.0:1786400488.650400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400488.650814:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368813824 00000100:00100000:1.0:1786400488.650836:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368813824 00000100:00100000:1.0:1786400488.650911:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:1.0:1786400488.650920:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10424:x1873176368813824:12345-192.168.201.23@tcp:103:lfs.0 00010000:00010000:1.0:1786400488.650957:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786400488.650982:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a55a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f514b expref: 54 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.651006:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a55fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5160 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.651033:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a54ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f510c expref: 52 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400488.651044:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801400) 00010000:00010000:1.0:1786400488.651055:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400488.651124:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:10424:x1873176368813824:12345-192.168.201.23@tcp:103:lfs.0 Request processed in 204us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400488.651132:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:3.0:1786400488.662929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400488.663035:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368813952 00000100:00100000:0.0:1786400488.663045:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368813952 00000100:00100000:0.0:1786400488.663117:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:0.0:1786400488.663127:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:10424:x1873176368813952:12345-192.168.201.23@tcp:58:lfs.0 00010000:00010000:0.0:1786400488.663249:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.663265:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400488.663277:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786400488.663566:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786400488.664484:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1786400488.664555:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1786400488.664692:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:10424:x1873176368813952:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 1563us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400488.664707:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:0.0:1786400488.739837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400488.741273:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368814080 00000100:00100000:2.0:1786400488.741287:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368814080 00000100:00100000:2.0:1786400488.741355:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:2.0:1786400488.741364:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:10426:x1873176368814080:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400488.741392:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400488.741412:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a561f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f516e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741500:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741515:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741527:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741542:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741549:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741556:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741690:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741710:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741718:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400488.741799:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1786400488.741804:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400488.741823:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741835:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741844:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741851:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741858:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741865:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400488.741869:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741877:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741888:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400488.741891:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400488.741901:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741908:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5626 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741922:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741930:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741936:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741942:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400488.741945:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741952:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741959:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff937386801900) 00010000:00010000:2.0:1786400488.741962:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400488.741965:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.741971:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a562d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.742001:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a561f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.742026:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400488.742033:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93739128d400) 00010000:00010000:2.0:1786400488.742036:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786400488.742039:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e800, rc 0) 00000100:00100000:2.0:1786400488.742472:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10426:x1873176368814080:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1107us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400488.742482:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 67 00000004:00080000:3.0:1786400488.851497:0:7823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410592755572ns, next at 411592752951ns, rc = 0 00000100:00100000:1.0:1786400488.851574:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400488.851624:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373bfe0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392961024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400488.851695:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400488.851839:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392961024 00000100:00100000:2.0:1786400488.851849:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392961024 00000100:00100000:2.0:1786400488.851902:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786400488.851911:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392961024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400488.851943:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400488.851995:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392961024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400488.852002:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786400488.852084:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373bfe0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392961024:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1786400489.107964:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400489.107973:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400489.108031:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1786400489.108042:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786400489.108175:0:11579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373bfe09f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392961152:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400489.108273:0:11579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373911683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400489.111203:0:11579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373bfe09f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392961152:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400489.112674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400489.112734:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368814208 00000100:00100000:0.0:1786400489.112767:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368814208 00000100:00100000:0.0:1786400489.112826:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:0.0:1786400489.112836:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10437:x1873176368814208:12345-192.168.201.23@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1786400489.112919:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10437:x1873176368814208:12345-192.168.201.23@tcp:900:lhsmtool_posix.0 Request processed in 84us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400489.112936:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:0.0:1786400489.115517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400489.115596:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368814336 00000100:00100000:1.0:1786400489.115606:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368814336 00000100:00100000:1.0:1786400489.115668:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:1.0:1786400489.115688:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10437:x1873176368814336:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786400489.115720:0:5817:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786400489.115922:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10437:x1873176368814336:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 244us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.115931:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:0.0:1786400489.149842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400489.150066:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368814464 00000100:00100000:1.0:1786400489.150077:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368814464 00000100:00100000:1.0:1786400489.150128:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:1.0:1786400489.150138:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10437:x1873176368814464:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786400489.150218:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150236:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150264:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150326:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150335:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150343:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150369:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150378:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150385:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400489.150424:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1786400489.150428:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400489.150460:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150471:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150478:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150493:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150499:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400489.150503:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150510:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150522:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:1.0:1786400489.150525:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400489.150529:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150536:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a563b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150549:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150555:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150561:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150566:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400489.150568:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150596:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150605:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9373850bf600) 00010000:00010000:1.0:1786400489.150607:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400489.150610:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150617:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5642 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150631:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150636:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150652:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150657:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400489.150660:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150666:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150672:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93739128d400) 00010000:00010000:1.0:1786400489.150675:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400489.150678:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.150694:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400489.150798:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10437:x1873176368814464:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 661us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400489.150807:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:1.0:1786400489.156191:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.156268:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368814720 00000100:00100000:3.0:1786400489.156280:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368814720 00000100:00100000:3.0:1786400489.156342:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:3.0:1786400489.156351:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10437:x1873176368814720:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400489.156373:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400489.156394:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5650 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5175 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156498:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156514:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156525:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400489.156537:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1786400489.156665:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156690:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156696:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156702:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400489.156706:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156715:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156729:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93739128d400) 00010000:00010000:3.0:1786400489.156732:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400489.156870:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156879:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156921:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5650 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5175 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.156997:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:3.0:1786400489.157000:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400489.157005:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5650 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5175 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.157016:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763e00, rc 0) 00000100:00100000:3.0:1786400489.157077:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10437:x1873176368814720:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 727us (895us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1786400489.157085:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:0.0:1786400489.170205:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400489.170283:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368814848 00000100:00100000:1.0:1786400489.170293:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368814848 00000100:00100000:1.0:1786400489.170350:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:1.0:1786400489.170360:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10437:x1873176368814848:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786400489.170399:0:5816:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786400489.170528:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10437:x1873176368814848:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 168us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400489.170536:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:0.0:1786400489.177254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.177793:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368815104 00000100:00100000:3.0:1786400489.177804:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368815104 00000100:00100000:3.0:1786400489.177859:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 72 00000100:00100000:3.0:1786400489.177879:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10437:x1873176368815104:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400489.177898:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400489.177902:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786400489.178220:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5167 expref: 53 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.178242:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:3.0:1786400489.178247:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400489.178262:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5665 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f517c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786400489.181034:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1786400489.181307:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a566c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.181324:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a566c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.181337:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a566c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.181405:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5665 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f517c expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.181447:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a566c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f517c expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.181456:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9373a3445500) 00010000:00010000:3.0:1786400489.181459:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400489.181462:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763800, rc 0) 00000100:00100000:3.0:1786400489.181542:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10437:x1873176368815104:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 3663us (4296us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1786400489.181551:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 72 00000100:00100000:0.0:1786400489.200175:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400489.200273:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368815360 00000100:00100000:2.0:1786400489.200290:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368815360 00000100:00100000:2.0:1786400489.200364:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:2.0:1786400489.200382:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10437:x1873176368815360:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786400489.200472:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400489.200508:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a566c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f517c expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200560:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9373a3445500) 00010000:00010000:2.0:1786400489.200574:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400489.200631:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200656:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200668:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200686:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200694:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200699:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200815:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200823:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200830:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200835:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400489.200839:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200854:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200863:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400489.200866:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400489.200869:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200875:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a567a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200884:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200890:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200896:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200902:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400489.200904:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200909:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.200916:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xaa7eec62 (ffff937386801900) 00010000:00010000:2.0:1786400489.200918:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400489.200920:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.201184:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5681 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaa7eec62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400489.201280:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10437:x1873176368815360:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 899us (1116us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400489.201289:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:0.0:1786400489.205231:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400489.206493:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368815488 00000100:00100000:2.0:1786400489.206505:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368815488 00000100:00100000:2.0:1786400489.206572:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:2.0:1786400489.206593:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10437:x1873176368815488:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400489.206618:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400489.206657:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5688 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5183 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.206694:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.206707:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.206718:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.217162:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.217191:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 54 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.217201:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400489.217204:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786400489.217208:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e400, rc 0) 00000100:00100000:0.0:1786400489.217334:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10437:x1873176368815488:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 10742us (12109us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400489.217362:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:3.0:1786400489.242391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400489.242522:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368815744 00000100:00100000:2.0:1786400489.242532:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368815744 00000100:00100000:2.0:1786400489.242594:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:2.0:1786400489.242604:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10437:x1873176368815744:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786400489.242689:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.242718:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.242730:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400489.243308:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1786400489.243320:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410984580320ns, next at 411984577666ns, rc = 0 00000004:00010000:2.0:1786400489.243419:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db1daa88 reply state 00000000e07a461b transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400489.243539:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400489.243697:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10437:x1873176368815744:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 1092us (1313us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1786400489.243706:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 75 00010000:00010000:1.0:1786400489.270829:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.270848:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.270857:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.270864:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400489.270869:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.270898:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.270918:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:1.0:1786400489.270933:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786400489.270938:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.270945:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5696 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400489.272463:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.280318:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368815872 00000100:00100000:3.0:1786400489.280333:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368815872 00000100:00100000:3.0:1786400489.280438:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:3.0:1786400489.280449:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10437:x1873176368815872:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400489.280473:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400489.280496:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f518a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.280555:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.280572:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.280604:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400489.280620:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786400489.280624:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763000, rc 0) 00000100:00100000:3.0:1786400489.280696:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10437:x1873176368815872:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 248us (8240us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.280703:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:3.0:1786400489.284696:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400489.286057:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368816000 00000100:00100000:0.0:1786400489.286067:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368816000 00000100:00100000:0.0:1786400489.286119:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:0.0:1786400489.286128:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1873176368816000:12345-192.168.201.23@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1786400489.286159:0:10836:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:0.0:1786400489.286191:0:10836:0:(genops.c:1406:class_connect()) connect: client 2e546c9b-fa03-4565-a5c8-6992a70a28db, cookie 0x49554f35ff0a56a4 00002000:00100000:0.0:1786400489.286203:0:10836:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e546c9b-fa03-4565-a5c8-6992a70a28db/ffff9373b890f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786400489.286231:0:10836:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786400489.286840:0:10836:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786400489.286871:0:10836:0:(import.c:65:import_set_state_nolock()) ffff937391238000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400489.287007:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2358:x1873176368816000:12345-192.168.201.23@tcp:8:lhsmtool_posix.0 Request processed in 878us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400489.287016:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:0.0:1786400489.291012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400489.291137:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368816128 00000100:00100000:2.0:1786400489.291147:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368816128 00000100:00100000:2.0:1786400489.291221:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:2.0:1786400489.291233:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:0:x1873176368816128:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1786400489.293538:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1786400489.407702:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000001:00080000:0.0:1786400489.407734:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1786400489.408324:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:0:x1873176368816128:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 117088us (117316us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1786400489.408337:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:1.0:1786400489.424263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.424423:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368816384 00000100:00100000:3.0:1786400489.424432:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368816384 00000100:00100000:3.0:1786400489.424757:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:3.0:1786400489.424769:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10437:x1873176368816384:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786400489.425054:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:10437:x1873176368816384:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 280us (793us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1786400489.425062:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:0.0:1786400489.439320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.439426:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368816640 00000100:00100000:3.0:1786400489.439437:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368816640 00000100:00100000:3.0:1786400489.439503:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:3.0:1786400489.439514:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:10437:x1873176368816640:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786400489.439647:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:10437:x1873176368816640:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 134us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.439656:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:0.0:1786400489.443359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.445473:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368816768 00000100:00100000:3.0:1786400489.445486:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368816768 00000100:00100000:3.0:1786400489.445545:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:3.0:1786400489.445555:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:10437:x1873176368816768:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400489.445588:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400489.445609:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5191 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.445699:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a56b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.445713:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a56b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.445724:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a56b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400489.445790:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400489.445809:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a56b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.445837:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5191 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.445853:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a56b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5191 expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.445862:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400489.445864:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786400489.445867:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763200, rc 0) 00000100:00100000:3.0:1786400489.446534:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:10437:x1873176368816768:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 976us (3180us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.446543:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:1.0:1786400489.451767:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400489.451805:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368816896 00000100:00100000:1.0:1786400489.451814:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368816896 00000100:00100000:1.0:1786400489.451870:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:1.0:1786400489.451881:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368816896:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400489.451901:0:10836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400489.453731:0:10836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5198 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400489.453781:0:10836:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a4ee9, blocks: 0x1 00010000:00010000:1.0:1786400489.453804:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:1.0:1786400489.453809:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400489.453821:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 6 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.453860:0:10836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 6 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.453874:0:10836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebfa00, rc 0) 00000100:00100000:1.0:1786400489.455356:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368816896:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 3468us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400489.455369:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:0.0:1786400489.464789:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.464885:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368817152 00000100:00100000:3.0:1786400489.464896:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368817152 00000100:00100000:3.0:1786400489.464962:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:3.0:1786400489.464987:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:10437:x1873176368817152:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786400489.465829:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:10437:x1873176368817152:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 840us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.465840:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:3.0:1786400489.471850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400489.471953:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368817280 00000100:00100000:1.0:1786400489.471963:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368817280 00000100:00100000:1.0:1786400489.472027:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:1.0:1786400489.472039:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:10437:x1873176368817280:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400489.472072:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400489.472101:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f519f expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.472139:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 7 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.472150:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400489.472154:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400489.472160:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.472218:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 7 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.472239:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 7 pid: 10836 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400489.472254:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9111f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6624:1873176392961280:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400489.472346:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff937386df0480 going to sleep for 11 seconds 00000100:00100000:2.0:1786400489.479564:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9111f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6624:1873176392961280:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400489.479617:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.479667:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebfc00, rc 0) 00000100:00100000:2.0:1786400489.479766:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:10437:x1873176368817280:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 7702us (7900us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400489.479775:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:1.0:1786400489.494125:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.494239:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368817408 00000100:00100000:3.0:1786400489.494249:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368817408 00010000:00010000:3.0:1786400489.494291:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 7 pid: 10836 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400489.494334:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:3.0:1786400489.494345:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368817408:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400489.494359:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400489.494380:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 7 pid: 10836 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.494394:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 7 pid: 10836 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.494419:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000466fbf9a/0x49554f35ff0a56b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5198 expref: 7 pid: 10836 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.494436:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400489.494441:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400489.494448:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.494473:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.494512:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400489.494525:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373bfe09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5801:1873176392961408:192.168.201.23@tcp:105: 00000100:00100000:3.0:1786400489.494616:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff937391168900 going to sleep for 11 seconds 00000100:00100000:0.0:1786400489.498121:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373bfe09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5801:1873176392961408:192.168.201.23@tcp:105: 00010000:00010000:0.0:1786400489.498152:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400489.498205:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368817408:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 3861us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400489.498232:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:3.0:1786400489.511855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400489.511964:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368817536 00000100:00100000:2.0:1786400489.511975:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368817536 00002000:00100000:2.0:1786400489.512025:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9373bfe0b100 x1873176368817536/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:285/0 lens 504/0 e 0 to 0 dl 1786400500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400489.512036:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373bfe0b100 with x1873176368817536 ext(0->8) 00002000:00010000:2.0:1786400489.512042:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373bfe0b100 00000100:00100000:2.0:1786400489.512091:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:2.0:1786400489.512101:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368817536:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786400489.512775:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368817536:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 Request processed in 673us (939us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1786400489.512783:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00002000:00100000:2.0:1786400489.512790:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9373bfe0b100 x1873176368817536/t4294967302(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:285/0 lens 504/448 e 0 to 0 dl 1786400500 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400489.512798:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373bfe0b100 with x1873176368817536 ext(0->8) 00002000:00010000:2.0:1786400489.512802:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373bfe0b100 00000100:00100000:3.0:1786400489.531122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400489.535014:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368817664 00000100:00100000:2.0:1786400489.535029:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368817664 00000100:00100000:2.0:1786400489.535111:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:2.0:1786400489.535122:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:10437:x1873176368817664:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1786400489.632834:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400489.702856:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:10437:x1873176368817664:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 167726us (171733us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400489.702870:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00000001:00080000:2.0:1786400489.702912:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000001:00080000:2.0:1786400489.702926:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:2.0:1786400489.702942:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1786400489.702965:0:5839:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9373b7372d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1786400489.702970:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373bf426200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9373b7372c00 00000020:00080000:2.0:1786400489.702973:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373bf426a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9373bfe01000 00000001:00080000:2.0:1786400489.702988:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1786400489.702992:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1786400489.703037:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:3.0:1786400489.705546:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.705592:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368817792 00000100:00100000:3.0:1786400489.705600:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368817792 00000100:00100000:3.0:1786400489.705660:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:3.0:1786400489.705670:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368817792:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1786400489.706074:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1786400489.706488:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1786400489.706616:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1786400489.706648:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373bfe0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392961536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786400489.707306:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400489.707374:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392961536 00000100:00100000:1.0:1786400489.707380:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392961536 00000100:00100000:1.0:1786400489.707419:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786400489.707427:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392961536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786400489.707610:0:10836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1786400489.707614:0:10836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786400489 00002000:00010000:1.0:1786400489.707617:0:10836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786400489.707619:0:10836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1786400489 -> 1786400489 00002000:00010000:1.0:1786400489.707622:0:10836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786400489.707665:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392961536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (359us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1786400489.707673:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786400489.709191:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400489.709222:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392961664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786400489.709282:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400489.709329:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392961664 00000100:00100000:1.0:1786400489.709335:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392961664 00000100:00100000:1.0:1786400489.709367:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786400489.709375:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392961664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786400489.709398:0:6623:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1786400489.709428:0:6623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a7a4ee5, atime: 0x6a7a4ee5, ctime: 0x6a7a4ee5, blocks: 0x1 00010000:00010000:1.0:1786400489.709436:0:6623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.709452:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=411s v=(0 0) 00010000:00010000:1.0:1786400489.709456:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400489.709463:0:6623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.709479:0:6623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.709491:0:6623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.709499:0:6623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.709518:0:6623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786400489.710025:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1873176392961664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 648us (740us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1786400489.710038:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:1.0:1786400489.713206:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373bfe0aa00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1786400489.713220:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373bfe0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392961536:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1786400489.713255:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400489.713263:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.713276:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebee00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400489.713281:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.713294:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.713319:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.713327:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a813095/0x49554f35ff0a56c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.713349:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400489.713351:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400489.713353:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786400489.713388:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b9110000/2, rc 0, transno 4294967301 00000100:00100000:1.0:1786400489.713393:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392961664:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786400489.763450:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.763488:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.763515:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.763542:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368818048 00000100:00100000:3.0:1786400489.763551:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368818048 00000100:00100000:3.0:1786400489.763617:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:3.0:1786400489.763637:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368818048:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400489.763711:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368818048:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 85us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.763731:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:3.0:1786400489.763773:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368817920 00000100:00100000:3.0:1786400489.763776:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368817920 00000100:00100000:3.0:1786400489.763798:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 292 00000100:00100000:3.0:1786400489.763804:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368817920:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400489.763830:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368817920:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.763837:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 292 00000100:00100000:3.0:1786400489.763863:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368818176 00000100:00100000:3.0:1786400489.763866:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368818176 00000100:00100000:3.0:1786400489.763890:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 147 00000100:00100000:3.0:1786400489.763896:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368818176:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400489.763921:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368818176:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.763927:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 147 00000100:00080000:0.0:1786400489.765339:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400489.765348:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400489.857297:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368817792:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 151616us (151746us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400489.857311:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:1.0:1786400489.861811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.862437:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368818432 00000100:00100000:3.0:1786400489.862449:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368818432 00000100:00100000:3.0:1786400489.862549:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:3.0:1786400489.862578:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:10437:x1873176368818432:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786400489.862678:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400489.862731:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a56b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5191 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.862794:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400489.862800:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400489.863333:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.863347:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.863358:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786400489.863673:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077ca3c3f reply state 00000000211b58b3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400489.863684:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786400489.864371:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:10437:x1873176368818432:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 1810us (2569us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1786400489.864381:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:1.0:1786400489.867976:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400489.868011:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368818560 00000100:00100000:1.0:1786400489.868021:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368818560 00000100:00100000:1.0:1786400489.868254:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:1.0:1786400489.868264:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368818560:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1786400489.868466:0:10836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1786400489.868470:0:10836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1786400489 -> 1786400487 00002000:00010000:1.0:1786400489.868473:0:10836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786400485 00002000:00010000:1.0:1786400489.868475:0:10836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1786400489 -> 1786400487 00002000:00010000:1.0:1786400489.868478:0:10836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1786400489.868529:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2361:x1873176368818560:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 265us (566us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1786400489.868537:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00000001:00080000:0.0:1786400489.869395:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1786400489.869910:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.869923:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.869932:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.869938:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400489.869943:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.869958:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.869975:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400489.869978:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400489.869982:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.869987:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400489.878933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.879014:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368818816 00000100:00100000:3.0:1786400489.879024:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368818816 00000100:00100000:3.0:1786400489.879107:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:3.0:1786400489.879118:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:10437:x1873176368818816:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786400489.879198:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.879215:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.879224:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.879262:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.879276:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 13 pid: 5818 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400489.879305:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373bfe09500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392961792:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400489.879392:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff937381254480 going to sleep for 11 seconds 00000100:00100000:3.0:1786400489.881054:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400489.881072:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392961920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400489.881136:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400489.881303:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392961920 00000100:00100000:2.0:1786400489.881310:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392961920 00000100:00100000:2.0:1786400489.881361:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786400489.881369:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392961920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400489.881390:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1786400489.881438:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392961920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400489.881445:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786400489.881490:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392961920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400489.885807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400489.885886:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368818944 00000100:00100000:2.0:1786400489.885896:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368818944 00010000:00010000:2.0:1786400489.885938:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 14 pid: 5818 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400489.885998:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:2.0:1786400489.886007:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9110a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:2361:x1873176368818944:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400489.886025:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400489.886032:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 14 pid: 5818 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.886056:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 14 pid: 5818 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.886090:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400489.886096:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.886107:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.886115:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.886134:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400489.886183:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9110a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:2361:x1873176368818944:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 177us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400489.886191:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00010000:00010000:3.0:1786400489.886943:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a568f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5183 expref: 13 pid: 5818 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400489.886962:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373bfe09500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392961792:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400489.886984:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.886993:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.887000:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.887031:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.887049:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.887057:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.887063:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400489.887086:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.887094:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.887106:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400489.887109:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786400489.887113:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.887119:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400489.887177:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:10437:x1873176368818816:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 Request processed in 8061us (8255us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786400489.887187:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:1.0:1786400489.897526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.899217:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368819072 00000100:00100000:3.0:1786400489.899235:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368819072 00000100:00100000:2.0:1786400489.912404:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:2.0:1786400489.912420:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2359:x1873176368819072:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786400489.912467:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.912495:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.912505:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400489.912510:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400489.912515:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.912552:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.912567:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 7 pid: 6624 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400489.912596:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6624:1873176392962048:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400489.912711:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b73663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400489.921971:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6624:1873176392962048:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400489.922003:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400489.922895:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400489.930563:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368819200 00000100:00100000:1.0:1786400489.930591:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368819200 00010000:00010000:1.0:1786400489.930681:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 8 pid: 6624 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400489.930731:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1786400489.930772:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368819200:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400489.930800:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400489.930825:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 8 pid: 6624 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.930840:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 8 pid: 6624 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.930863:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ce55f0/0x49554f35ff0a56c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f519f expref: 8 pid: 6624 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.930876:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400489.930881:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400489.930887:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.930897:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.930924:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400489.930945:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.930955:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.930979:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.930996:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.931005:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.931012:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ec00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400489.931017:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.931027:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.931459:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400489.931470:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a56dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400489.931554:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2359:x1873176368819072:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 19137us (34041us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400489.931563:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:1.0:1786400489.931614:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368819200:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 875us (8774us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400489.931621:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1786400489.936824:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400489.936923:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368819456 00000100:00100000:3.0:1786400489.936932:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368819456 00000100:00100000:3.0:1786400489.936993:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:3.0:1786400489.937004:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:10437:x1873176368819456:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786400489.937102:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.937121:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.937133:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.937634:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.937648:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.937656:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.937690:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400489.937705:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 13 pid: 5817 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400489.937719:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373bfe09500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392962176:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400489.937938:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff937381254480 going to sleep for 11 seconds 00000100:00100000:1.0:1786400489.943234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400489.943585:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373bfe09500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392962176:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400489.943615:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400489.945735:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368819584 00000100:00100000:0.0:1786400489.945763:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368819584 00010000:00010000:0.0:1786400489.945812:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 14 pid: 5817 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400489.945858:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:0.0:1786400489.945868:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9112a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:2362:x1873176368819584:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400489.945883:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400489.945890:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 14 pid: 5817 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.945905:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 14 pid: 5817 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.945927:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a569d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f518a expref: 14 pid: 5817 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.945944:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400489.945948:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.945957:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.945981:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.946006:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400489.946066:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9112a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:2362:x1873176368819584:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 198us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400489.946073:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00010000:00010000:2.0:1786400489.946899:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.946911:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400489.947133:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1786400489.947297:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1786400489.947346:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1786400489.947663:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392962304:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786400489.947727:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400489.947813:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7366480 going to sleep for 11 seconds 00000100:00100000:0.0:1786400489.948608:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392962304 00000100:00100000:0.0:1786400489.948616:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392962304 00000100:00100000:0.0:1786400489.948691:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400489.948702:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5817:x1873176392962304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400489.948817:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5817:x1873176392962304:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400489.948837:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400489.951477:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392962304:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786400489.957019:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1786400489.958892:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392962432:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400489.958967:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400489.959004:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84840 going to sleep for 11 seconds 00000100:00100000:0.0:1786400489.959035:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392962432 00000100:00100000:0.0:1786400489.959208:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392962432 00000100:00100000:0.0:1786400489.959265:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400489.959275:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5817:x1873176392962432:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400489.959510:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1873176392962432:12345-0@lo:1000:mdt00_001.0 Request processed in 236us (542us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1786400489.959519:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400489.959565:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392962432:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786400489.960357:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960370:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960379:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960385:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400489.960390:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960398:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960416:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400489.960420:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400489.960425:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960431:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a56ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960469:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960477:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960483:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960502:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400489.960505:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960512:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960522:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93739128d400) 00010000:00010000:0.0:1786400489.960525:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400489.960528:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400489.960535:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5618 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.968804:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.968835:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.968846:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.968891:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400489.968908:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 16 pid: 5816 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400489.968923:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392962560:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400489.969063:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7366240 going to sleep for 11 seconds 00000100:00100000:1.0:1786400490.009972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.010087:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368819712 00000100:00100000:3.0:1786400490.010097:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368819712 00010000:00010000:3.0:1786400490.010157:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 17 pid: 5816 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400490.010200:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:3.0:1786400490.010211:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:2361:x1873176368819712:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400490.010228:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400490.010235:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 17 pid: 5816 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.010270:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 17 pid: 5816 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.010294:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93739128d400) 00010000:00010000:3.0:1786400490.010300:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.010309:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.010316:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.010334:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400490.010389:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:2361:x1873176368819712:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 180us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400490.010398:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00080000:1.0:1786400490.010647:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786400490.015850:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f516e expref: 16 pid: 5816 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400490.015900:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392962560:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400490.015924:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.015960:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.015967:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.015982:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.015990:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.015998:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016004:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400490.016008:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016016:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016032:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93739128d400) 00010000:00010000:2.0:1786400490.016046:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400490.016051:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016069:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a56f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016280:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016286:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016293:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016299:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400490.016302:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016308:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016318:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93739128d400) 00010000:00010000:2.0:1786400490.016320:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400490.016323:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.016330:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a56e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400490.016613:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:10437:x1873176368819456:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 79609us (79797us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1786400490.016622:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00000020:00080000:2.0:1786400490.016636:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1786400490.016904:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400490.016909:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400490.016935:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1786400490.016940:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400490.027700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400490.027829:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368819968 00000100:00100000:0.0:1786400490.027848:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368819968 00000100:00100000:0.0:1786400490.027905:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:0.0:1786400490.027916:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:10437:x1873176368819968:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786400490.028596:0:5820:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786400490.028702:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1786400490.028786:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.028803:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.028816:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.028836:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.028855:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.028863:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.028876:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786400490.028969:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:10437:x1873176368819968:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1052us (1278us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1786400490.028978:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000020:00080000:0.0:1786400490.028983:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400490.030595:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400490.030609:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.030619:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400490.030624:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.030634:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.030651:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93739128dd00) 00010000:00010000:1.0:1786400490.030654:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786400490.030661:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.030667:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a56f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.030690:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400490.030692:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400490.030694:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786400490.382885:0:11889:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400490.382896:0:11889:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400490.382931:0:11889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1786400490.382935:0:11889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400490.597721:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.597837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368820224 00000100:00100000:3.0:1786400490.597848:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368820224 00000100:00100000:3.0:1786400490.597902:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:3.0:1786400490.597912:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:10448:x1873176368820224:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400490.597936:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400490.597956:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a56ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51a6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.598256:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5706 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.598274:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.598291:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400490.598303:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1786400490.598619:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a56ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51a6 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.598637:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51a6 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.598645:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:3.0:1786400490.598649:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786400490.598652:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763600, rc 0) 00000100:00100000:3.0:1786400490.598717:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:10448:x1873176368820224:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 805us (1005us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1786400490.598725:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:2.0:1786400490.601531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.601637:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368820352 00000100:00100000:3.0:1786400490.601648:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368820352 00000100:00100000:3.0:1786400490.601708:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:3.0:1786400490.601718:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:10448:x1873176368820352:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:3.0:1786400490.601832:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.601865:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.601879:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.601896:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.601903:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.601910:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602231:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602240:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602247:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786400490.602286:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602298:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602304:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602320:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602326:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400490.602330:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602338:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602534:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:3.0:1786400490.602538:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400490.602543:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602549:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602574:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602581:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602586:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602592:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400490.602595:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602611:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602619:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9373a3445300) 00010000:00010000:3.0:1786400490.602621:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400490.602624:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602629:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a571b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602643:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602649:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602655:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602660:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400490.602662:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602668:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602674:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445f00) 00010000:00010000:3.0:1786400490.602676:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400490.602679:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.602694:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400490.602809:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:10448:x1873176368820352:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 1089us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400490.602818:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 85 00010000:00010000:1.0:1786400490.649018:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400490.679130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.679251:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368820608 00000100:00100000:3.0:1786400490.679261:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368820608 00000100:00100000:3.0:1786400490.679352:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:3.0:1786400490.679363:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:10451:x1873176368820608:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400490.679389:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400490.679416:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5729 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51ad expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.679491:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.679506:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.679517:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.679531:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.679539:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.679581:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680121:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680131:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680140:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400490.680150:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1786400490.680237:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680245:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680252:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680259:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400490.680263:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680271:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680284:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:3.0:1786400490.680287:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400490.680298:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680305:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680317:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680324:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680329:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680335:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400490.680338:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680344:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680352:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9373a3445f00) 00010000:00010000:3.0:1786400490.680354:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400490.680357:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680362:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680405:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5729 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680431:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.680439:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:3.0:1786400490.680442:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400490.680445:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763200, rc 0) 00000100:00100000:3.0:1786400490.680570:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:10451:x1873176368820608:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1208us (1448us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1786400490.680579:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:1.0:1786400490.683698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.683902:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368820736 00000100:00100000:3.0:1786400490.683911:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368820736 00000100:00100000:3.0:1786400490.683967:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:3.0:1786400490.683977:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:10451:x1873176368820736:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:3.0:1786400490.684150:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684167:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684182:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684208:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684216:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684234:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684240:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400490.684245:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684253:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684267:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:3.0:1786400490.684269:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400490.684274:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.684281:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a574c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400490.684362:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:10451:x1873176368820736:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 386us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400490.684370:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:2.0:1786400490.686258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400490.686354:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368820992 00000100:00100000:0.0:1786400490.686362:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368820992 00000100:00100000:0.0:1786400490.686444:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:0.0:1786400490.686454:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739026ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:10451:x1873176368820992:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1786400490.686690:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739026ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:10451:x1873176368820992:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 237us (438us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1786400490.686699:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1786400490.720830:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.721216:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368821248 00000100:00100000:3.0:1786400490.721225:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368821248 00000100:00100000:3.0:1786400490.721287:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:3.0:1786400490.721297:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:9979:x1873176368821248:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1786400490.721322:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400490.721529:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5753 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51b4 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.721675:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.721690:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.721699:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.721735:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.721791:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 23 pid: 5816 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400490.721805:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373bfe0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392962688:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400490.721923:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff937282a7f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400490.729808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.729980:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373bfe0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392962688:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400490.730008:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400490.730138:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368821376 00000100:00100000:2.0:1786400490.730146:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368821376 00010000:00010000:2.0:1786400490.730188:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 24 pid: 5816 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400490.730220:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:2.0:1786400490.730230:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9112680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:2361:x1873176368821376:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400490.730245:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400490.730252:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 24 pid: 5816 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.730265:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 24 pid: 5816 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.730287:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a573e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ad expref: 24 pid: 5816 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.730304:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:2.0:1786400490.730310:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.730319:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.730327:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.730388:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400490.730436:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9112680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:2361:x1873176368821376:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 207us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400490.730444:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00010000:00010000:1.0:1786400490.730676:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.730684:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400490.730704:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1786400490.730916:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5753 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 24 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.730932:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 23 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.730939:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:1.0:1786400490.730942:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786400490.730944:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763e00, rc 0) 00000100:00100000:1.0:1786400490.730971:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:9979:x1873176368821248:12345-192.168.201.23@tcp:101:bash.0 Request processed in 9676us (10154us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1786400490.730977:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:2.0:1786400490.740835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400490.740937:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368821632 00000100:00100000:0.0:1786400490.740946:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368821632 00000100:00100000:0.0:1786400490.741011:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 89 00000100:00100000:0.0:1786400490.741047:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:9979:x1873176368821632:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:0.0:1786400490.741330:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.741467:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.741481:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786400490.741536:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1786400490.741576:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c1b8128 reply state 000000003959b906 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400490.741587:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1786400490.741640:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1786400490.741948:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:9979:x1873176368821632:12345-192.168.201.23@tcp:36:bash.0 Request processed in 901us (1123us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1786400490.741956:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 89 00000020:00080000:0.0:1786400490.741961:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1786400490.749639:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.749775:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368821760 00000100:00100000:3.0:1786400490.749785:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368821760 00000100:00100000:3.0:1786400490.749848:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 90 00000100:00100000:3.0:1786400490.749858:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:9979:x1873176368821760:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1786400490.749881:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400490.749913:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a576f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51bb expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.749972:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a576f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51bb expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.749987:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a576f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51bb expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.750004:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:3.0:1786400490.750007:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786400490.750011:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762600, rc 0) 00000100:00100000:3.0:1786400490.750222:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+28:9979:x1873176368821760:12345-192.168.201.23@tcp:101:bash.0 Request processed in 365us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400490.750230:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 90 00010000:00010000:1.0:1786400490.751139:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.751153:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.751160:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.751166:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400490.751180:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.751189:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.751202:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:1.0:1786400490.751205:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400490.751208:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400490.751214:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5768 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400490.764212:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400490.767247:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368821888 00000100:00100000:2.0:1786400490.767263:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368821888 00000100:00100000:2.0:1786400490.767328:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:2.0:1786400490.767338:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:9979:x1873176368821888:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400490.767369:0:10836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400490.767392:0:10836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51c2 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400490.767418:0:10836:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a7a4ee7, atime: 0x6a7a4ee5, ctime: 0x6a7a4ee7, blocks: 0xb 00010000:00010000:2.0:1786400490.767441:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1786400490.767446:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400490.767455:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 7 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.767474:0:10836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 7 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.767488:0:10836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f200, rc 0) 00000100:00100000:2.0:1786400490.767575:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:9979:x1873176368821888:12345-192.168.201.23@tcp:101:bash.0 Request processed in 237us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400490.767600:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:2.0:1786400490.773276:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400490.773468:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368822016 00000100:00100000:1.0:1786400490.773478:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368822016 00002000:00010000:1.0:1786400490.773523:0:6628:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1786400490.773528:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373984c4e00 with x1873176368822016 ext(0->18446744073709551615) 00002000:00010000:1.0:1786400490.773541:0:6628:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373984c4e00. 00000100:00100000:1.0:1786400490.773602:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:1.0:1786400490.773620:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368822016:12345-192.168.201.23@tcp:10:bash.0 00002000:00010000:1.0:1786400490.774342:0:6628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1786400490.774348:0:6628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1786400487 -> 1786400490 00002000:00010000:1.0:1786400490.774351:0:6628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1786400485 -> 1786400485 00002000:00010000:1.0:1786400490.774354:0:6628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1786400487 -> 1786400490 00002000:00010000:1.0:1786400490.774356:0:6628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1786400490.777544:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368822016:12345-192.168.201.23@tcp:10:bash.0 Request processed in 3920us (4265us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1786400490.777591:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00002000:00010000:1.0:1786400490.777598:0:6628:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1786400490.777602:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373984c4e00 with x1873176368822016 ext(0->18446744073709551615) 00002000:00010000:1.0:1786400490.777612:0:6628:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373984c4e00. 00000100:00100000:3.0:1786400490.784839:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400490.785367:0:6629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368822144 00000100:00100000:2.0:1786400490.785377:0:6629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368822144 00002000:00100000:2.0:1786400490.785427:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9373bfe0a300 x1873176368822144/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:286/0 lens 496/0 e 0 to 0 dl 1786400501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400490.785437:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373bfe0a300 with x1873176368822144 ext(0->7) 00002000:00010000:2.0:1786400490.785443:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373bfe0a300 00000100:00100000:2.0:1786400490.785478:0:6629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:2.0:1786400490.785487:0:6629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368822144:12345-192.168.201.23@tcp:4:bash.0 00000100:00100000:2.0:1786400490.786015:0:6629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2361:x1873176368822144:12345-192.168.201.23@tcp:4:bash.0 Request processed in 527us (1184us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1786400490.786024:0:6629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00002000:00100000:2.0:1786400490.786031:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9373bfe0a300 x1873176368822144/t4294967307(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:286/0 lens 496/448 e 0 to 0 dl 1786400501 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400490.786040:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373bfe0a300 with x1873176368822144 ext(0->7) 00002000:00010000:2.0:1786400490.786043:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373bfe0a300 00000100:00100000:3.0:1786400490.792838:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400490.792934:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368822272 00000100:00100000:0.0:1786400490.792943:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368822272 00000100:00100000:0.0:1786400490.793000:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:0.0:1786400490.793010:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2361:x1873176368822272:12345-192.168.201.23@tcp:16:kworker.0 00000100:00100000:0.0:1786400490.836507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400490.836547:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368822400 00000100:00100000:0.0:1786400490.836566:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368822400 00000100:00100000:0.0:1786400490.836620:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:0.0:1786400490.836630:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:10465:x1873176368822400:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:0.0:1786400490.836714:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.836731:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.836772:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.836788:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.836796:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.836803:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837137:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837148:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837157:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400490.837196:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837208:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837225:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837233:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837240:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400490.837245:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837253:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837266:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400490.837269:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400490.837274:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837281:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a577d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837294:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837301:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837307:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837313:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400490.837321:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837328:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837335:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93739128dc00) 00010000:00010000:0.0:1786400490.837338:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400490.837341:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837347:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837361:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837367:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837373:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837377:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400490.837381:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837387:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837394:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:0.0:1786400490.837396:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400490.837405:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.837411:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a578b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400490.837495:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:10465:x1873176368822400:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 864us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400490.837505:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 91 00000001:00080000:2.0:1786400490.865420:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1786400490.865440:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1786400490.865449:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:0.0:1786400490.865666:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368822272:12345-192.168.201.23@tcp:16:kworker.0 Request processed in 72651us (72833us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400490.865677:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:1.0:1786400490.865899:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.866359:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368822656 00000100:00100000:3.0:1786400490.866368:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368822656 00000100:00100000:3.0:1786400490.866418:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:3.0:1786400490.866427:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:10468:x1873176368822656:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400490.866450:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400490.866469:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51c9 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866540:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866564:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866591:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866617:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866625:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866633:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866971:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a57a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866981:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a57a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.866989:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a57a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400490.867000:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1786400490.867216:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867225:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867232:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867239:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400490.867249:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867257:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867269:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:3.0:1786400490.867272:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400490.867277:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867284:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867296:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867302:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867308:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867313:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400490.867316:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867322:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867329:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9373a3445700) 00010000:00010000:3.0:1786400490.867331:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400490.867339:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867345:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a57a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867385:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c9 expref: 30 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867399:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a57a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c9 expref: 29 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400490.867406:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:3.0:1786400490.867409:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786400490.867411:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763200, rc 0) 00000100:00100000:3.0:1786400490.867459:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:10468:x1873176368822656:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1032us (1561us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1786400490.867467:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:1.0:1786400490.872916:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400490.873015:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368822784 00000100:00100000:0.0:1786400490.873035:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368822784 00000100:00100000:0.0:1786400490.873105:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:0.0:1786400490.873116:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:10468:x1873176368822784:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:0.0:1786400490.873187:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.873203:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 29 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.873212:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.873248:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 29 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.873262:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 29 pid: 8098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400490.873297:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a03800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392962816:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400490.873395:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400490.878213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.878362:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368823040 00000100:00100000:3.0:1786400490.878372:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368823040 00000100:00100000:3.0:1786400490.878440:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:3.0:1786400490.878450:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:5576:x1873176368823040:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786400490.878826:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:5576:x1873176368823040:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 376us (624us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1786400490.878835:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1786400490.881481:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a03800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392962816:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400490.881515:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400490.890316:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400490.890479:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368823168 00000100:00100000:0.0:1786400490.890490:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368823168 00010000:00010000:0.0:1786400490.890536:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 31 pid: 8098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400490.890591:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:0.0:1786400490.890602:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:2361:x1873176368823168:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400490.890619:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400490.890627:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 31 pid: 8098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.890641:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 31 pid: 8098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.890923:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a575a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51b4 expref: 31 pid: 8098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.890940:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:0.0:1786400490.890945:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.890968:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.890977:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400490.891155:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400490.891221:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:2361:x1873176368823168:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 620us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400490.891230:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00010000:00010000:0.0:1786400490.892782:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.892795:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.892829:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.892837:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.892845:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.892852:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400490.892856:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.892864:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.892879:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:0.0:1786400490.892882:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400490.892992:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400490.893013:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a57b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400490.897705:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:10468:x1873176368822784:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 24578us (24786us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400490.897720:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:1.0:1786400490.902215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400490.902297:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368823424 00000100:00100000:3.0:1786400490.902310:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368823424 00000100:00100000:3.0:1786400490.902379:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:3.0:1786400490.902389:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:10468:x1873176368823424:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400490.902871:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:10468:x1873176368823424:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 481us (663us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1786400490.902881:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000001:00080000:2.0:1786400491.019252:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1786400491.019272:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1786400491.019792:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400491.025861:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368823680 00000100:00100000:3.0:1786400491.025878:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368823680 00000100:00100000:2.0:1786400491.026192:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:2.0:1786400491.026204:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:10479:x1873176368823680:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:2.0:1786400491.026232:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400491.026255:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51d0 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026338:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026353:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026365:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026380:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026387:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026393:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026777:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a57d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026788:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a57d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026802:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a57d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400491.026813:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1786400491.026922:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026930:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026936:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026942:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.026947:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026955:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026967:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400491.026971:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.026975:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026981:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026993:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.026999:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.027010:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.027015:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ee00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.027276:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.027286:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.027295:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff937386801200) 00010000:00010000:2.0:1786400491.027298:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.027301:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.027308:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.027360:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d0 expref: 33 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.027374:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a57d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d0 expref: 32 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.027382:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:2.0:1786400491.027384:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400491.027387:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fc00, rc 0) 00000100:00100000:2.0:1786400491.027462:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:10479:x1873176368823680:12345-192.168.201.23@tcp:101:cat.0 Request processed in 1259us (7673us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1786400491.027478:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:3.0:1786400491.033169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.034088:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368823936 00000100:00100000:2.0:1786400491.034102:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368823936 00000100:00100000:2.0:1786400491.034166:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:2.0:1786400491.034177:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:10479:x1873176368823936:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:2.0:1786400491.034448:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+33:10479:x1873176368823936:12345-192.168.201.23@tcp:35:cat.0 Request processed in 271us (1288us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1786400491.034455:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:0.0:1786400491.066080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.066203:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368824192 00000100:00100000:2.0:1786400491.066214:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368824192 00000100:00100000:2.0:1786400491.066276:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:2.0:1786400491.066286:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+33:10480:x1873176368824192:12345-192.168.201.23@tcp:36:rm.0 00010000:00010000:2.0:1786400491.066348:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786400491.066375:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a57d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d0 expref: 33 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066396:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a57a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c9 expref: 32 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066408:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a576f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51bb expref: 31 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066419:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9373a3445300) 00010000:00010000:2.0:1786400491.066430:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400491.066451:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066476:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066487:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066501:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066508:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066515:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066855:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066864:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.066872:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400491.067479:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1786400491.067488:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412808748365ns, next at 413808746281ns, rc = 0 00010000:00010000:2.0:1786400491.067565:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067574:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067591:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067599:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067605:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067611:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067632:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400491.067656:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067661:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067667:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067672:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.067676:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067684:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067694:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801e00) 00010000:00010000:2.0:1786400491.067697:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786400491.067707:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067713:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a57ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067730:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067736:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067774:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067778:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.067781:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067786:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067795:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400491.067797:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.067800:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.067805:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400491.067815:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d57fbd8c reply state 000000000d35d719 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400491.067836:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400491.067935:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:10480:x1873176368824192:12345-192.168.201.23@tcp:36:rm.0 Request processed in 1646us (1862us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1786400491.067944:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 95 00010000:00010000:0.0:1786400491.068691:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400491.068700:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.068710:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fe00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400491.068831:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.068843:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.068856:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff937386801e00) 00010000:00010000:0.0:1786400491.068859:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786400491.068863:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.068870:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a57f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.068897:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400491.068900:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400491.068902:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400491.073721:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.073769:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.073777:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.073784:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ee00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400491.073788:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.073796:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.073814:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff937386801200) 00010000:00010000:3.0:1786400491.073817:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400491.073822:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.073828:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a57e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400491.116300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.116406:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368824448 00000100:00100000:2.0:1786400491.116417:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368824448 00000100:00100000:2.0:1786400491.116480:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00100000:2.0:1786400491.116490:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:10486:x1873176368824448:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400491.116514:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400491.116533:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51d7 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.116671:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.116685:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.116697:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.116711:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.116718:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.116725:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400491.117298:0:8098:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1786400491.117463:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117473:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117481:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117511:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117518:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117525:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117532:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.117536:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117544:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117569:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400491.117573:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.117578:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117595:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a5802 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400491.117608:0:8098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffc73a11 reply state 000000002420d896 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400491.117618:0:8098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786400491.117647:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a57fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 34 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117660:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 33 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.117667:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801d00) 00010000:00010000:2.0:1786400491.117669:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400491.117672:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f800, rc 0) 00000100:00100000:2.0:1786400491.117782:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:10486:x1873176368824448:12345-192.168.201.23@tcp:101:bash.0 Request processed in 1249us (1447us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1786400491.117791:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 96 00010000:00010000:1.0:1786400491.125775:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.125795:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.125803:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.125809:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fc00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400491.125814:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.125822:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.125841:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff937386801c00) 00010000:00010000:1.0:1786400491.125860:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400491.125865:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.125872:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5809 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400491.134038:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.134336:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368824576 00000100:00100000:2.0:1786400491.134347:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368824576 00000100:00100000:2.0:1786400491.134422:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:2.0:1786400491.134432:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368824576:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400491.134451:0:10836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400491.134476:0:10836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51de expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400491.134523:0:10836:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400491.134542:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1786400491.134560:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400491.134571:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 6 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.134592:0:10836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 6 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.134614:0:10836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e600, rc 0) 00000100:00100000:2.0:1786400491.134675:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368824576:12345-192.168.201.23@tcp:101:bash.0 Request processed in 244us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400491.134682:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00080000:1.0:1786400491.135637:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400491.138701:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400491.138855:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368824704 00000100:00100000:1.0:1786400491.138865:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368824704 00000100:00100000:1.0:1786400491.138927:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:1.0:1786400491.138937:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:10486:x1873176368824704:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1786400491.138956:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400491.138974:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51e5 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.139007:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 7 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.139017:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400491.139021:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400491.139027:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.139128:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 7 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.139145:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 7 pid: 10836 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400491.139178:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6624:1873176392962944:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400491.139274:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387310a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400491.164133:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6624:1873176392962944:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400491.164169:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.164191:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebfa00, rc 0) 00000100:00100000:1.0:1786400491.164250:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:10486:x1873176368824704:12345-192.168.201.23@tcp:101:bash.0 Request processed in 25314us (25558us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400491.164260:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:2.0:1786400491.167102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400491.167235:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368824832 00000100:00100000:3.0:1786400491.167259:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368824832 00010000:00010000:3.0:1786400491.167297:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 7 pid: 10836 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400491.167346:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:3.0:1786400491.167356:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368824832:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400491.167371:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400491.167392:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 7 pid: 10836 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.167407:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 7 pid: 10836 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.167428:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a581e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51de expref: 7 pid: 10836 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.167449:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400491.167454:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400491.167462:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.167472:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.167510:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400491.167537:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373bfe08a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5801:1873176392963072:192.168.201.23@tcp:105: 00000100:00100000:3.0:1786400491.167698:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372180 going to sleep for 11 seconds 00000100:00100000:2.0:1786400491.174879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400491.174994:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373bfe08a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5801:1873176392963072:192.168.201.23@tcp:105: 00010000:00010000:3.0:1786400491.175018:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400491.175082:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368824832:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 7726us (7989us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400491.175093:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1786400491.175645:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368825088 00000100:00100000:0.0:1786400491.175653:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368825088 00000100:00100000:0.0:1786400491.175726:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:0.0:1786400491.175773:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+33:10486:x1873176368825088:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:0.0:1786400491.176558:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:10486:x1873176368825088:12345-192.168.201.23@tcp:35:bash.0 Request processed in 811us (1676us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1786400491.176567:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:2.0:1786400491.455692:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.455882:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368825216 00000100:00100000:0.0:1786400491.455894:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368825216 00000100:00100000:0.0:1786400491.455956:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 97 00000100:00100000:0.0:1786400491.455966:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:10502:x1873176368825216:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400491.455992:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400491.456013:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a582c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.456083:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.456097:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.456110:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400491.456167:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1786400491.456170:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400491.456192:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.456217:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a582c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ec expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.456256:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ec expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.456265:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400491.456268:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400491.456272:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031c00, rc 0) 00000100:00100000:0.0:1786400491.456330:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:10502:x1873176368825216:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 364us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400491.456337:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 97 00000100:00100000:1.0:1786400491.474698:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.475022:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368825472 00000100:00100000:2.0:1786400491.475031:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368825472 00000100:00100000:2.0:1786400491.475103:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:2.0:1786400491.475114:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:10502:x1873176368825472:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400491.475137:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400491.475160:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a583a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51f3 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.475284:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.475299:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.475310:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400491.475321:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1786400491.475458:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a583a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51f3 expref: 38 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.475477:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51f3 expref: 37 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.475485:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801d00) 00010000:00010000:2.0:1786400491.475488:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400491.475491:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fa00, rc 0) 00000100:00100000:2.0:1786400491.475570:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:10502:x1873176368825472:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 458us (881us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1786400491.475577:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:2.0:1786400491.481083:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.481134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.481271:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368825856 00000100:00100000:0.0:1786400491.481281:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368825856 00000100:00100000:0.0:1786400491.481344:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:0.0:1786400491.481355:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:10502:x1873176368825856:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400491.481380:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400491.481399:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a584f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f51fa expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.481499:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5856 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.481514:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.481527:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400491.481540:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786400491.481697:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a584f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51fa expref: 40 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.481717:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51fa expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.481726:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801d00) 00010000:00010000:0.0:1786400491.481729:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786400491.481733:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031600, rc 0) 00000100:00100000:0.0:1786400491.481832:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:10502:x1873176368825856:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 478us (761us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1786400491.481841:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:3.0:1786400491.486233:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368825600 00000100:00100000:3.0:1786400491.486248:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368825600 00000100:00100000:3.0:1786400491.486332:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1786400491.486343:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:2361:x1873176368825600:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400491.486359:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400491.486386:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51f3 expref: 39 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.486407:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801d00) 00010000:00010000:3.0:1786400491.486412:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400491.486478:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:2361:x1873176368825600:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 136us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400491.486486:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:2.0:1786400491.487367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400491.487451:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368825984 00000100:00100000:1.0:1786400491.487457:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368825984 00000100:00100000:1.0:1786400491.487499:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:1.0:1786400491.487508:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368825984:12345-192.168.201.23@tcp:1:lfs.0 00010000:00010000:1.0:1786400491.487553:0:10836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.487573:0:10836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.487582:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786400491.487587:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400491.487592:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.487650:0:10836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.487664:0:10836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 6 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400491.487681:0:10836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10836:1873176392963200:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400491.487796:0:10836:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387310a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400491.492033:0:10836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10836:1873176392963200:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400491.492076:0:10836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400491.493339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400491.493697:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368826112 00000100:00100000:1.0:1786400491.493705:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368826112 00002000:00100000:1.0:1786400491.493803:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9373b79c7480 x1873176368826112/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:287/0 lens 504/0 e 0 to 0 dl 1786400502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400491.493813:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b79c7480 with x1873176368826112 ext(0->8) 00010000:00010000:1.0:1786400491.493823:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 7 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.493839:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 7 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400491.493846:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9373b79c7480 00000100:00100000:1.0:1786400491.494021:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:1.0:1786400491.494031:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368826112:12345-192.168.201.23@tcp:4:lfs.0 00000100:00100000:1.0:1786400491.494518:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2361:x1873176368826112:12345-192.168.201.23@tcp:4:lfs.0 Request processed in 487us (1181us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1786400491.494526:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00002000:00100000:1.0:1786400491.494533:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9373b79c7480 x1873176368826112/t4294967302(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:287/0 lens 504/448 e 0 to 0 dl 1786400502 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400491.494550:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b79c7480 with x1873176368826112 ext(0->8) 00010000:00010000:1.0:1786400491.494558:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 9 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.494567:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 9 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400491.494575:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9373b79c7480 00000100:00100000:0.0:1786400491.497464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400491.497553:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368826240 00000100:00100000:3.0:1786400491.497563:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368826240 00010000:00010000:3.0:1786400491.497615:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 9 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400491.497673:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:3.0:1786400491.497684:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2359:x1873176368826240:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400491.497701:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786400491.497721:0:5801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1786400491.497725:0:5801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786400490 00002000:00010000:3.0:1786400491.497727:0:5801:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786400491 00002000:00010000:3.0:1786400491.497729:0:5801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1786400490 00010000:00010000:3.0:1786400491.497735:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 9 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.497778:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 9 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.497806:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5825 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51e5 expref: 9 pid: 6624 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.497824:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400491.497830:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400491.497836:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.497847:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.498150:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400491.498216:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2359:x1873176368826240:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 533us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400491.498225:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00010000:00010000:1.0:1786400491.498834:0:10836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.498859:0:10836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.498897:0:10836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.498907:0:10836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.498925:0:10836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.498933:0:10836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfe00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400491.498938:0:10836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.498948:0:10836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.498964:0:10836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.498973:0:10836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff46dbd4/0x49554f35ff0a5864 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400491.499046:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368825984:12345-192.168.201.23@tcp:1:lfs.0 Request processed in 11538us (11680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400491.499281:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:0.0:1786400491.504163:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400491.504239:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368826496 00000100:00100000:1.0:1786400491.504252:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368826496 00000100:00100000:1.0:1786400491.504317:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:1.0:1786400491.504329:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390269050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:10502:x1873176368826496:12345-192.168.201.23@tcp:35:lfs.0 00000004:00010000:1.0:1786400491.504392:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51fa expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400491.504720:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1786400491.504805:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1786400491.505141:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1786400491.505198:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.505212:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 42 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.505220:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.505253:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 42 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.505266:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 42 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400491.505280:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5820:1873176392963328:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400491.505358:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400491.517991:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400491.518184:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5820:1873176392963328:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400491.518218:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400491.518303:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368826624 00000100:00100000:2.0:1786400491.518328:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368826624 00010000:00010000:2.0:1786400491.518369:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 43 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400491.518413:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:2.0:1786400491.518422:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:2362:x1873176368826624:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400491.518440:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400491.518446:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 43 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.518459:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 43 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.518480:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5810 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51d7 expref: 43 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.518495:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801d00) 00010000:00010000:2.0:1786400491.518500:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.518508:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.518516:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.518553:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400491.518606:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+42:2362:x1873176368826624:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 184us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400491.518624:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00010000:00010000:1.0:1786400491.518723:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.518731:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400491.518932:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1786400491.519159:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1786400491.519285:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392963456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786400491.519347:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400491.519377:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc6300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400491.520312:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392963456 00000100:00100000:2.0:1786400491.520321:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392963456 00000100:00100000:2.0:1786400491.520373:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786400491.520381:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1873176392963456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786400491.520454:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1873176392963456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 73us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400491.520460:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1786400491.520628:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400491.520659:0:5820:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1786400491.520665:0:5820:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1786400491.520683:0:5820:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b9110000, transno 4294967301 00000100:00100000:1.0:1786400491.520703:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392963456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1786400491.521193:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1786400491.521258:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392963584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786400491.521293:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400491.521313:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400491.521471:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392963584 00000100:00100000:0.0:1786400491.521476:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392963584 00000100:00100000:0.0:1786400491.521511:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786400491.521519:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1873176392963584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786400491.521703:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1873176392963584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 183us (407us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1786400491.521710:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400491.521798:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392963584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786400491.521842:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1786400491.521889:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.521898:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.521907:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.521913:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebee00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400491.521918:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.521926:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.521942:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801d00) 00010000:00010000:3.0:1786400491.521944:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786400491.521948:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.521954:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a586b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786400491.522125:0:5820:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1786400491.522219:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1786400491.522238:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413263497925ns, next at 414263496510ns, rc = 0 00000001:00080000:3.0:1786400491.522244:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1786400491.522272:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801d00) 00010000:00010000:3.0:1786400491.522275:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786400491.522282:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5856 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51fa expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400491.522380:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390269050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:10502:x1873176368826496:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 18054us (18226us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1786400491.522389:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000020:00080000:3.0:1786400491.522393:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1786400491.527222:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.527317:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368826752 00000100:00100000:2.0:1786400491.527327:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368826752 00000100:00100000:2.0:1786400491.527389:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:2.0:1786400491.527399:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:10502:x1873176368826752:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400491.527426:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400491.527449:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5201 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.527507:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5201 expref: 46 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.527522:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5201 expref: 46 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.527552:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400491.527555:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400491.527560:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f800, rc 0) 00000100:00100000:2.0:1786400491.527626:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+46:10502:x1873176368826752:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 228us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400491.527648:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:0.0:1786400491.533268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.533367:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368827008 00000100:00100000:2.0:1786400491.533378:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368827008 00000100:00100000:2.0:1786400491.533443:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:2.0:1786400491.533453:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+46:10502:x1873176368827008:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400491.533809:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:10502:x1873176368827008:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 357us (550us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1786400491.533818:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:0.0:1786400491.636416:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.636627:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368827136 00000100:00100000:2.0:1786400491.636639:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368827136 00000100:00100000:2.0:1786400491.636703:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:2.0:1786400491.636714:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:10512:x1873176368827136:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:2.0:1786400491.636824:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.636853:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.636866:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.636998:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637008:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637015:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637162:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637171:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637178:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400491.637220:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637233:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637241:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637247:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637254:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.637258:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637266:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637277:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400491.637280:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.637285:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637299:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5879 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637314:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637320:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637326:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637331:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.637334:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637340:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637348:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff937386801400) 00010000:00010000:2.0:1786400491.637350:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.637352:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637357:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637372:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637378:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637389:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637395:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.637398:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637404:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637413:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400491.637416:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.637419:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.637424:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400491.638193:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:10512:x1873176368827136:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 1476us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400491.638205:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 101 00010000:00010000:1.0:1786400491.668527:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400491.714982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400491.715095:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368827392 00000100:00100000:2.0:1786400491.715106:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368827392 00000100:00100000:2.0:1786400491.715216:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 102 00000100:00100000:2.0:1786400491.715227:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:10515:x1873176368827392:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400491.715250:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400491.715273:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a588e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5208 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715385:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715401:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715412:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715428:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715435:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715443:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715583:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a58a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715593:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a58a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715612:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a58a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400491.715622:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1786400491.715956:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715965:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715980:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.715987:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.715991:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716000:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716012:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400491.716016:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.716020:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716027:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5895 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716051:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716058:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716064:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716069:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400491.716073:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716089:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716098:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff937386801400) 00010000:00010000:2.0:1786400491.716100:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400491.716104:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716110:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a589c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716153:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a588e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5208 expref: 50 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716167:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a58a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5208 expref: 49 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.716174:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400491.716177:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400491.716179:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e800, rc 0) 00000100:00100000:2.0:1786400491.716262:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+49:10515:x1873176368827392:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1035us (1287us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1786400491.716271:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 102 00000100:00100000:0.0:1786400491.719975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400491.720859:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368827520 00000100:00100000:1.0:1786400491.720871:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368827520 00000100:00100000:1.0:1786400491.721149:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:1.0:1786400491.721161:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+49:10515:x1873176368827520:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:1.0:1786400491.721234:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721251:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721264:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721314:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721322:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721329:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721335:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfe00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400491.721339:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721347:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721368:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:1.0:1786400491.721371:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400491.721375:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.721381:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a58b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400491.721460:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+49:10515:x1873176368827520:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 300us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400491.724118:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400491.724152:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368827776 00000100:00100000:3.0:1786400491.724161:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368827776 00000100:00100000:3.0:1786400491.724206:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:3.0:1786400491.724215:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:10515:x1873176368827776:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400491.724445:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:10515:x1873176368827776:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 230us (335us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1786400491.724452:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:1.0:1786400491.741279:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:2.0:1786400491.831688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.831865:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368828032 00000100:00100000:0.0:1786400491.831899:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368828032 00000100:00100000:0.0:1786400491.831963:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 104 00000100:00100000:0.0:1786400491.831973:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:10525:x1873176368828032:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400491.831999:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400491.832003:0:8098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786400491.832032:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51ec expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.832060:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400491.832067:0:8098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400491.832081:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a58b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f520f expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.832187:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.832202:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.832213:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400491.832225:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786400491.832349:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a58b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f520f expref: 52 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.832363:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f520f expref: 51 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.832371:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400491.832380:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400491.832383:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:0.0:1786400491.832453:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:10525:x1873176368828032:12345-192.168.201.23@tcp:101:bash.0 Request processed in 480us (774us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1786400491.832461:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 104 00000100:00100000:3.0:1786400491.837663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.837832:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368828288 00000100:00100000:0.0:1786400491.837854:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368828288 00000100:00100000:0.0:1786400491.837919:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 105 00000100:00100000:0.0:1786400491.837930:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:10525:x1873176368828288:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:0.0:1786400491.837993:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786400491.838019:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f520f expref: 51 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.838042:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a58a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5208 expref: 50 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.838063:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400491.838069:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400491.838260:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.838276:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.838286:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786400491.838332:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1786400491.838356:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b00643e3 reply state 000000007360f7ac transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400491.838381:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786400491.838479:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10525:x1873176368828288:12345-192.168.201.23@tcp:36:bash.0 Request processed in 550us (825us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1786400491.838486:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 105 00000020:00080000:0.0:1786400491.838492:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786400491.841782:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.841799:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.841808:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.841832:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400491.841838:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.841856:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.841880:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400491.841883:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400491.841888:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400491.841895:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400491.844592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.844720:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368828416 00000100:00100000:0.0:1786400491.844731:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368828416 00000100:00100000:0.0:1786400491.844826:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 106 00000100:00100000:0.0:1786400491.844836:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:10525:x1873176368828416:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400491.845055:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400491.845076:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a58d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5216 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.845161:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.845175:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.845185:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400491.845215:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786400491.845219:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400491.845236:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.845260:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a58d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 53 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.845299:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 52 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.845308:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400491.845311:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400491.845314:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031c00, rc 0) 00000100:00100000:0.0:1786400491.845382:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10525:x1873176368828416:12345-192.168.201.23@tcp:101:bash.0 Request processed in 548us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400491.845390:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 106 00000100:00100000:1.0:1786400491.850421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400491.850584:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368828672 00000100:00100000:3.0:1786400491.850603:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368828672 00000100:00100000:3.0:1786400491.850675:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:3.0:1786400491.850686:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:10525:x1873176368828672:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:2.0:1786400491.851333:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10525:x1873176368828672:12345-192.168.201.23@tcp:35:bash.0 Request processed in 647us (920us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1786400491.851342:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:2.0:1786400491.924829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.925055:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368828800 00000100:00100000:0.0:1786400491.925069:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368828800 00000100:00100000:0.0:1786400491.925139:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 107 00000100:00100000:0.0:1786400491.925150:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:10531:x1873176368828800:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400491.925175:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400491.925197:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a58e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f521d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.925260:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.925275:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.925287:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400491.925347:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1786400491.925362:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400491.925391:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.925417:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a58e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f521d expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.925435:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f521d expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.925443:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400491.925447:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400491.925450:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:0.0:1786400491.925520:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10531:x1873176368828800:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 373us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400491.925528:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 107 00000100:00100000:3.0:1786400491.930372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.930448:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368828928 00000100:00100000:0.0:1786400491.930458:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368828928 00000100:00100000:0.0:1786400491.930517:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 108 00000100:00100000:0.0:1786400491.930528:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10531:x1873176368828928:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400491.930560:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400491.930581:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a58f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5224 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.930683:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.930699:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.930721:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.930767:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.930776:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.930784:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931159:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931168:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931175:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400491.931211:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786400491.931215:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400491.931232:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931244:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931252:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931269:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931277:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931283:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400491.931288:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931296:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931308:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400491.931311:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400491.931315:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931320:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a58f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931332:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931338:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931343:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931348:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c2176400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400491.931357:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931363:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931372:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93739128dc00) 00010000:00010000:0.0:1786400491.931374:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400491.931377:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931383:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a58fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931418:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a58f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 56 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931430:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 55 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.931437:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400491.931439:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400491.931442:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c2176000, rc 0) 00000100:00100000:0.0:1786400491.931517:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10531:x1873176368828928:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 991us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400491.931525:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 108 00000100:00100000:3.0:1786400491.937126:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400491.937169:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.937306:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368829184 00000100:00100000:0.0:1786400491.937316:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368829184 00000100:00100000:0.0:1786400491.937395:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 109 00000100:00100000:0.0:1786400491.937406:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10531:x1873176368829184:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400491.937440:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400491.937459:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a590c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f522b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.937570:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.937586:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 56 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.937605:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 56 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.937612:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.937661:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 56 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.937676:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 56 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400491.937691:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373c017d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392963712:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400491.937832:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 56 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.937842:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 56 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400491.937984:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373c017df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392963840:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400491.938013:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400491.938265:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368829312 00000100:00100000:2.0:1786400491.938271:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368829312 00010000:00010000:2.0:1786400491.938296:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 57 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400491.938330:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:2.0:1786400491.938338:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:2359:x1873176368829312:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400491.938348:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400491.938353:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 57 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.938364:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 57 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.938385:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400491.938389:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.938396:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400491.938401:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400491.938427:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:2359:x1873176368829312:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 90us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400491.938434:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00010000:00010000:0.0:1786400491.941926:0:5817:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.23@tcp) returned -22 from blocking AST (req@00000000455f1f9f x1873176392963712) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 56 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.941951:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5224 expref: 56 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400491.941970:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373c017d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392963712:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400491.941984:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373c017df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392963840:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400491.942007:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400491.942013:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.942021:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.942052:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400491.944303:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400491.944466:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368829440 00000100:00100000:1.0:1786400491.944475:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368829440 00010000:00010000:1.0:1786400491.944544:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 56 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400491.944585:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:1.0:1786400491.944600:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:2361:x1873176368829440:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400491.944614:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400491.944621:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 56 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.944667:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 56 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.944689:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a58db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5216 expref: 56 pid: 8098 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.944705:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:1.0:1786400491.944710:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.944718:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.944725:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.944800:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400491.944864:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:2361:x1873176368829440:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 271us (568us total) trans 0 rc 0/0 00010000:00010000:0.0:1786400491.945155:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.945164:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400491.945194:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1786400491.945346:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176400/0x49554f35ff0a590c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.945363:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.945369:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400491.945371:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400491.945373:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373c2176200, rc 0) 00000100:00100000:0.0:1786400491.945402:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10531:x1873176368829184:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 7999us (8287us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1786400491.945410:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 109 00000100:00100000:1.0:1786400491.945461:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:2.0:1786400491.950316:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.950401:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368829696 00000100:00100000:0.0:1786400491.950411:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368829696 00000100:00100000:0.0:1786400491.950477:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1786400491.950487:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10531:x1873176368829696:12345-192.168.201.23@tcp:103:lfs.0 00010000:00010000:0.0:1786400491.950505:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400491.950542:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5201 expref: 55 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.950561:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400491.950571:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400491.950645:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10531:x1873176368829696:12345-192.168.201.23@tcp:103:lfs.0 Request processed in 159us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400491.950653:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1786400491.954036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400491.954185:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368829824 00000100:00100000:0.0:1786400491.954195:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368829824 00000100:00100000:0.0:1786400491.954257:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00100000:0.0:1786400491.954266:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10531:x1873176368829824:12345-192.168.201.23@tcp:58:lfs.0 00010000:00010000:0.0:1786400491.954370:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.954387:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400491.954399:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786400491.954638:0:8098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1786400491.954721:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10531:x1873176368829824:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 455us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400491.954729:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00100000:3.0:1786400491.961032:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400491.961233:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368829952 00000100:00100000:1.0:1786400491.961244:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368829952 00000100:00100000:1.0:1786400491.961307:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 111 00000100:00100000:1.0:1786400491.961318:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:10531:x1873176368829952:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400491.961338:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400491.961358:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5232 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.961413:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.961425:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5232 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.961443:0:5816:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.961456:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5232 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.961470:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:1.0:1786400491.961473:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786400491.961477:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5232 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400491.961485:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf800, rc 0) 00000100:00100000:1.0:1786400491.961547:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10531:x1873176368829952:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 231us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400491.961555:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 111 00000040:00080000:3.0:1786400492.052778:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400492.052791:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400492.052853:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1786400492.052860:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786400492.053561:0:11579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392963968:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400492.054276:0:11579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7372e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400492.065788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400492.066122:0:11579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392963968:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786400492.070470:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368830080 00000100:00100000:2.0:1786400492.070504:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368830080 00000100:00100000:2.0:1786400492.070615:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 112 00000100:00100000:2.0:1786400492.070636:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10532:x1873176368830080:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786400492.070684:0:8098:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786400492.070816:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10532:x1873176368830080:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 182us (5039us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.070823:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 112 00000100:00080000:1.0:1786400492.072293:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400492.074928:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.075013:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368830208 00000100:00100000:1.0:1786400492.075023:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368830208 00000100:00100000:1.0:1786400492.075099:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:1.0:1786400492.075109:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10532:x1873176368830208:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786400492.075193:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075211:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075222:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075278:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075286:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075292:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075311:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075327:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075333:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400492.075366:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1786400492.075381:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400492.075393:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075403:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075408:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075414:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075419:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400492.075427:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075433:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075443:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:1.0:1786400492.075446:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400492.075450:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075455:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a592f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075466:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075470:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075484:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075489:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400492.075491:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075496:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075504:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9373850bf100) 00010000:00010000:1.0:1786400492.075506:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400492.075509:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075513:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5936 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075527:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075541:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075547:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075551:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400492.075554:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075568:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075579:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:1.0:1786400492.075581:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400492.075584:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.075600:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a593d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.076021:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10532:x1873176368830208:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 910us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400492.076031:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:0.0:1786400492.086167:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.086273:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368830464 00000100:00100000:2.0:1786400492.086283:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368830464 00000100:00100000:2.0:1786400492.086357:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:2.0:1786400492.086368:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:10532:x1873176368830464:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400492.086391:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400492.086412:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5944 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5239 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086512:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086526:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086547:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400492.086559:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1786400492.086683:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086691:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086715:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086721:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400492.086725:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086733:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086783:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400492.086787:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786400492.086792:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086798:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a594b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.086854:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5944 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5239 expref: 57 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.087285:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:2.0:1786400492.087290:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400492.087294:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5944 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5239 expref: 57 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.087305:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fe00, rc 0) 00000100:00100000:2.0:1786400492.087381:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10532:x1873176368830464:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 1016us (1226us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1786400492.087400:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:3.0:1786400492.113084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.113478:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368830592 00000100:00100000:2.0:1786400492.113490:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368830592 00000100:00100000:2.0:1786400492.113565:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:2.0:1786400492.113576:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10532:x1873176368830592:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786400492.113627:0:5817:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786400492.113773:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10532:x1873176368830592:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 162us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.113783:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:1.0:1786400492.123285:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.123487:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368830848 00000100:00100000:2.0:1786400492.124033:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368830848 00000100:00100000:2.0:1786400492.124116:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:2.0:1786400492.124127:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10532:x1873176368830848:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400492.124154:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400492.124157:0:8098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786400492.124186:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a58e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f521d expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.124207:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400492.124212:0:8098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400492.124225:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5959 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5240 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400492.127248:0:8098:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1786400492.127519:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.127562:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.127575:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.127641:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5959 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5240 expref: 58 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.127661:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5240 expref: 57 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.127670:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400492.127673:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400492.127677:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e200, rc 0) 00000100:00100000:2.0:1786400492.127773:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:10532:x1873176368830848:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 3646us (4497us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1786400492.127782:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:0.0:1786400492.133511:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.133602:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368831104 00000100:00100000:2.0:1786400492.133612:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368831104 00000100:00100000:2.0:1786400492.133680:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:2.0:1786400492.133690:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:10532:x1873176368831104:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786400492.133784:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400492.133812:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5240 expref: 57 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.133832:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff937386801400) 00010000:00010000:2.0:1786400492.133857:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400492.133892:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.133906:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.133916:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.133970:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.133979:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.133986:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134240:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134249:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134256:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134262:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ee00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400492.134267:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134276:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134292:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:2.0:1786400492.134296:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400492.134300:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134306:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a596e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134317:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134324:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134329:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134334:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fc00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400492.134336:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134342:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134348:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x24220a71 (ffff937386801300) 00010000:00010000:2.0:1786400492.134351:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400492.134353:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.134359:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5975 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x24220a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.134463:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10532:x1873176368831104:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 773us (971us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400492.134472:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:3.0:1786400492.139462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.139643:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368831232 00000100:00100000:1.0:1786400492.139655:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368831232 00000100:00100000:1.0:1786400492.139718:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:1.0:1786400492.139728:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:10532:x1873176368831232:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400492.139787:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400492.139810:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a597c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5247 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.139848:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.139862:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.139907:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.140010:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a597c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.140030:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.140052:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:1.0:1786400492.140055:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786400492.140058:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf600, rc 0) 00000100:00100000:1.0:1786400492.140107:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:10532:x1873176368831232:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 380us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400492.140115:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:3.0:1786400492.143263:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.143361:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368831488 00000100:00100000:2.0:1786400492.143371:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368831488 00000100:00100000:2.0:1786400492.143421:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:2.0:1786400492.143429:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:10532:x1873176368831488:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786400492.143509:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.143524:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.143547:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400492.143814:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1786400492.143823:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413885082923ns, next at 414885080892ns, rc = 0 00000004:00010000:2.0:1786400492.143911:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002dc9e64 reply state 00000000c06081ba transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.143920:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400492.144005:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:10532:x1873176368831488:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 576us (751us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1786400492.144013:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 119 00010000:00010000:2.0:1786400492.146904:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.146937:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.146945:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.146951:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fc00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400492.146956:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.146964:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.146980:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:2.0:1786400492.146983:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786400492.146987:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.146992:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a598a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.148133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400492.148228:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368831616 00000100:00100000:3.0:1786400492.148238:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368831616 00000100:00100000:3.0:1786400492.148290:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:3.0:1786400492.148300:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:10532:x1873176368831616:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400492.148335:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400492.148353:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f524e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.148410:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.148424:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.148441:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:3.0:1786400492.148444:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786400492.148447:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763c00, rc 0) 00000100:00100000:3.0:1786400492.148516:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:10532:x1873176368831616:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 217us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400492.148542:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:0.0:1786400492.153837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.153970:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368831744 00000100:00100000:2.0:1786400492.153979:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368831744 00000100:00100000:2.0:1786400492.154053:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:2.0:1786400492.154062:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368831744:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1786400492.154418:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368831744:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 357us (588us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1786400492.154426:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00080000:1.0:1786400492.154977:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400492.161488:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400492.164015:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368832000 00000100:00100000:3.0:1786400492.164030:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368832000 00000100:00100000:3.0:1786400492.164117:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:3.0:1786400492.164127:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:10532:x1873176368832000:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786400492.164398:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:10532:x1873176368832000:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 272us (2921us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1786400492.164405:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:0.0:1786400492.169676:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.169830:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368832256 00000100:00100000:2.0:1786400492.169855:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368832256 00000100:00100000:2.0:1786400492.169923:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:2.0:1786400492.169933:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:10532:x1873176368832256:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786400492.170061:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:10532:x1873176368832256:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 128us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.170069:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:0.0:1786400492.173572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400492.173779:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368832384 00000100:00100000:3.0:1786400492.173789:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368832384 00000100:00100000:3.0:1786400492.173854:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:3.0:1786400492.173873:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:10532:x1873176368832384:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400492.173894:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400492.173913:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5998 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.173980:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a599f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.173994:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a599f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.174004:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a599f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400492.174039:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400492.174269:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a599f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.174312:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5998 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5255 expref: 62 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.174396:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a599f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5255 expref: 61 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.174405:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:3.0:1786400492.174409:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786400492.174413:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763800, rc 0) 00000100:00100000:3.0:1786400492.174721:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:10532:x1873176368832384:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 856us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400492.174730:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:0.0:1786400492.192732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400492.192875:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368832512 00000100:00100000:3.0:1786400492.192886:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368832512 00000100:00100000:3.0:1786400492.192937:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:3.0:1786400492.192948:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2359:x1873176368832512:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400492.192967:0:6623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400492.192989:0:6623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f525c expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400492.193015:0:6623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a4eeb, blocks: 0x1 00010000:00010000:3.0:1786400492.193034:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=413s v=(0 0) 00010000:00010000:3.0:1786400492.193051:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400492.193060:0:6623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 8 pid: 6623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.193102:0:6623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 8 pid: 6623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.193114:0:6623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763000, rc 0) 00000100:00100000:3.0:1786400492.193163:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2359:x1873176368832512:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 217us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400492.193171:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:0.0:1786400492.202698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.203072:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368832768 00000100:00100000:2.0:1786400492.203082:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368832768 00000100:00100000:2.0:1786400492.203139:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:2.0:1786400492.203148:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:10532:x1873176368832768:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786400492.203461:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:10532:x1873176368832768:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 312us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.203469:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:0.0:1786400492.211509:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.211985:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368832896 00000100:00100000:2.0:1786400492.211995:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368832896 00000100:00100000:2.0:1786400492.212123:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:2.0:1786400492.212136:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:10532:x1873176368832896:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400492.212155:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400492.212175:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5263 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.212205:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 9 pid: 6623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.212214:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400492.212218:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400492.212237:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.212271:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 9 pid: 6623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.212285:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 9 pid: 6623 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.212299:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1873176392964096:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400492.214576:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff937381254480 going to sleep for 11 seconds 00000100:00100000:2.0:1786400492.225595:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1873176392964096:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400492.225650:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.225671:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fc00, rc 0) 00000100:00100000:2.0:1786400492.225766:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:10532:x1873176368832896:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 13631us (14265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.225775:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:0.0:1786400492.228116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.228223:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368833024 00000100:00100000:2.0:1786400492.228233:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368833024 00010000:00010000:2.0:1786400492.228279:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 9 pid: 6623 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.229798:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:2.0:1786400492.229818:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2361:x1873176368833024:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400492.229852:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400492.230029:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 9 pid: 6623 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.230154:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 9 pid: 6623 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.230177:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f525c expref: 9 pid: 6623 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.230194:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400492.230199:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400492.230206:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.230216:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.230259:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.230275:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1873176392964224:192.168.201.23@tcp:105: 00000100:00100000:2.0:1786400492.230432:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff937381254480 going to sleep for 11 seconds 00000100:00100000:2.0:1786400492.241982:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.242226:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368833152 00000100:00100000:1.0:1786400492.242236:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368833152 00002000:00100000:1.0:1786400492.242286:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9373b79c4000 x1873176368833152/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:288/0 lens 504/0 e 0 to 0 dl 1786400503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400492.242298:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b79c4000 with x1873176368833152 ext(0->12) 00002000:00010000:1.0:1786400492.242303:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b79c4000 00000100:00100000:1.0:1786400492.242347:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:1.0:1786400492.242357:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2362:x1873176368833152:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1786400492.243720:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+11:2362:x1873176368833152:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 Request processed in 1358us (1739us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1786400492.243769:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00002000:00100000:1.0:1786400492.243780:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9373b79c4000 x1873176368833152/t4294967309(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:288/0 lens 504/448 e 0 to 0 dl 1786400503 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400492.243791:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b79c4000 with x1873176368833152 ext(0->12) 00002000:00010000:1.0:1786400492.243796:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b79c4000 00000100:00100000:3.0:1786400492.244153:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1873176392964224:192.168.201.23@tcp:105: 00010000:00010000:3.0:1786400492.244175:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400492.244200:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2361:x1873176368833024:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 14391us (16093us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400492.244209:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:2.0:1786400492.255823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400492.256020:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368833280 00000100:00100000:0.0:1786400492.256046:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368833280 00000100:00100000:0.0:1786400492.256110:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:0.0:1786400492.256121:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:10532:x1873176368833280:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786400492.374730:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000020:00080000:0.0:1786400492.374793:0:5839:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff937390bc6300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1786400492.374798:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373b7209000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff937390bc6780 00000020:00080000:0.0:1786400492.374801:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373b7209100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9373b78b2c00 00000020:00080000:0.0:1786400492.374821:0:5839:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1786400492.374826:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1786400492.374830:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1786400492.375059:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1786400492.375069:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:0.0:1786400492.375166:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1786400492.375178:0:5839:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9373b7366480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1786400492.375181:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373b070d700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9373b7366e40 00000020:00080000:0.0:1786400492.375185:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373b070de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9373b893a000 00000100:00100000:3.0:1786400492.375760:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392964352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786400492.375816:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400492.376124:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400492.376131:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392964480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786400492.376157:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400492.376197:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392964352 00000100:00100000:3.0:1786400492.376205:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392964352 00000100:00100000:3.0:1786400492.376252:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392964480 00000100:00100000:3.0:1786400492.376255:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392964480 00000100:00100000:3.0:1786400492.376274:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786400492.376282:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1873176392964352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786400492.376305:0:6623:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000001:00080000:0.0:1786400492.376790:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1786400492.376808:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1786400492.376972:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:10532:x1873176368833280:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 120849us (121158us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.376985:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 124 00000020:00080000:1.0:1786400492.377147:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:3.0:1786400492.377441:0:6623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.377461:0:6623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 9 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.377470:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786400492.377475:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400492.377479:0:6623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.377535:0:6623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 9 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.377552:0:6623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 9 pid: 10836 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400492.377565:0:6623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6623:1873176392964608:192.168.201.23@tcp:104: 00000020:00080000:1.0:1786400492.378006:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1786400492.381013:0:6623:0:(client.c:2702:ptlrpc_set_wait()) set ffff937391168cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400492.381765:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392964736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786400492.381857:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400492.382190:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392964736 00000100:00100000:3.0:1786400492.382198:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392964736 00000100:00100000:3.0:1786400492.382235:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786400492.382245:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1873176392964480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786400492.384668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400492.384695:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.384835:0:6624:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1786400492.384846:0:6624:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1786400492.384881:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368833536 00000100:00100000:1.0:1786400492.384889:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368833536 00010000:00010000:1.0:1786400492.384924:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 10 pid: 10836 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.384959:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:1.0:1786400492.384967:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2361:x1873176368833536:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400492.384981:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400492.384987:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 10 pid: 10836 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385011:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 10 pid: 10836 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385065:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400492.385069:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400492.385075:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385083:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385102:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400492.385151:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2361:x1873176368833536:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 184us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400492.385158:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00010000:00010000:1.0:1786400492.385295:0:6623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5776 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51c2 expref: 9 pid: 10836 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.385309:0:6623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6623:1873176392964608:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400492.385339:0:6623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385349:0:6623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385357:0:6623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385377:0:6623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385385:0:6623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.385403:0:6623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786400492.385965:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1873176392964352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9681us (10147us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1786400492.385973:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786400492.385990:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368833408 00000100:00100000:1.0:1786400492.385994:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368833408 00000100:00100000:1.0:1786400492.386011:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786400492.386018:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392964736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786400492.386042:0:6623:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1786400492.386071:0:6623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a7a4eea, atime: 0x6a7a4eeb, ctime: 0x6a7a4eea, blocks: 0x1 00010000:00010000:1.0:1786400492.386078:0:6623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386088:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1786400492.386091:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400492.386096:0:6623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386108:0:6623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386121:0:6623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386129:0:6623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386142:0:6623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786400492.386545:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1873176392964736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 526us (4687us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1786400492.386551:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786400492.386567:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1786400492.386575:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2359:x1873176368833408:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1786400492.386621:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400492.386629:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386637:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763000 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400492.386641:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386650:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386664:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386678:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e7fcaf2/0x49554f35ff0a59b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386696:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400492.386700:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386707:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebea00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400492.386711:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386719:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386728:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386736:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078781a0b/0x49554f35ff0a59bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.386771:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400492.386772:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400492.386774:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400492.386794:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786400492.386848:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b79c7b80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1786400492.386856:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392964736:0@lo:6:osp-syn-1-0.0 00002000:00010000:3.0:1786400492.387236:0:10836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1786400492.387240:0:10836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786400492 00002000:00010000:3.0:1786400492.387243:0:10836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786400492.387245:0:10836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1786400491 -> 1786400492 00002000:00010000:3.0:1786400492.387254:0:10836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786400492.387289:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1873176392964480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5045us (11131us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1786400492.387296:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786400492.387454:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1786400492.387460:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373bfe0aa00, transno 4294967303 00000004:00080000:3.0:1786400492.387470:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1786400492.387491:0:3317:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9373b9111180 x1873176392964480/t4294967311(4294967311) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786400508 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786400492.387500:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b9111180/2, rc 0, transno 4294967311 00000100:00100000:3.0:1786400492.387504:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392964480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786400492.387516:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b9112680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1786400492.387519:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392964352:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1786400492.388685:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1786400492.488878:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1786400492.488895:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1786400492.488910:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:1.0:1786400492.489333:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368833408:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 102753us (104668us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400492.489344:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:0.0:1786400492.492559:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.492891:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368833792 00000100:00100000:1.0:1786400492.492902:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368833792 00000100:00100000:1.0:1786400492.492967:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00100000:1.0:1786400492.492977:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:10532:x1873176368833792:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786400492.493306:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400492.493351:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a599f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5255 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.493372:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:1.0:1786400492.493377:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400492.493409:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.493421:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.493430:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400492.493687:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db11f3c9 reply state 00000000083e0dc9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.493696:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400492.494965:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:10532:x1873176368833792:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 1981us (2407us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1786400492.494977:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 125 00010000:00010000:3.0:1786400492.502734:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.502790:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.502798:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.502805:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebea00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400492.502810:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.502819:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.502871:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:3.0:1786400492.502874:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400492.502879:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.502887:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a59c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400492.514386:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400492.515376:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368833920 00000100:00100000:3.0:1786400492.515388:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368833920 00000100:00100000:3.0:1786400492.515454:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:3.0:1786400492.515464:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368833920:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1786400492.515789:0:10836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1786400492.515793:0:10836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1786400492 -> 1786400491 00002000:00010000:3.0:1786400492.515795:0:10836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786400491 00002000:00010000:3.0:1786400492.515798:0:10836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1786400492 -> 1786400491 00002000:00010000:3.0:1786400492.515800:0:10836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1786400492.516029:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368833920:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 566us (1651us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1786400492.516046:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:0.0:1786400492.532534:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400492.532643:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368834176 00000100:00100000:3.0:1786400492.532652:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368834176 00000100:00100000:3.0:1786400492.532710:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 126 00000100:00100000:3.0:1786400492.532720:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:10532:x1873176368834176:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786400492.532809:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.532845:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.532856:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.532903:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.532917:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 15 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400492.532931:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392964864:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400492.533027:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff937391168b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400492.537920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.538156:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368834304 00000100:00100000:2.0:1786400492.538167:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368834304 00010000:00010000:2.0:1786400492.538207:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 16 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.538249:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:2.0:1786400492.538258:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:2361:x1873176368834304:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400492.538272:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400492.538279:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 16 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.538293:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 16 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.538327:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:2.0:1786400492.538332:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.538343:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.538351:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.538387:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400492.538444:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:2361:x1873176368834304:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 186us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.538452:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00010000:00010000:3.0:1786400492.540230:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5247 expref: 15 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400492.540253:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392964864:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400492.540276:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540286:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540292:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540333:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540354:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540362:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540369:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400492.540374:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540382:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540396:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:3.0:1786400492.540400:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786400492.540404:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.540410:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400492.540481:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:10532:x1873176368834176:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 Request processed in 7761us (7968us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786400492.540490:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 126 00000100:00100000:0.0:1786400492.559498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.559734:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368834432 00000100:00100000:1.0:1786400492.559780:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368834432 00000100:00100000:1.0:1786400492.559842:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:1.0:1786400492.559851:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2359:x1873176368834432:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786400492.559907:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.559928:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 7 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.559937:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786400492.559942:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400492.559947:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.559983:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 7 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.560009:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 7 pid: 6622 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.560024:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6624:1873176392964992:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400492.560107:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387310c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400492.563898:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6624:1873176392964992:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400492.563928:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400492.578107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.578224:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368834560 00000100:00100000:1.0:1786400492.578235:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368834560 00010000:00010000:1.0:1786400492.578278:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 8 pid: 6622 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.578341:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:1.0:1786400492.578351:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368834560:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400492.578366:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400492.578390:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 8 pid: 6622 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.578403:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 8 pid: 6622 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.578425:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a59ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5263 expref: 8 pid: 6622 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.578441:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400492.578445:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400492.578452:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.578460:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.578497:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400492.578561:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368834560:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 211us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400492.578568:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00010000:00010000:3.0:1786400492.579171:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.579380:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.579607:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.579627:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.579636:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.579643:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:3.0:1786400492.579647:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.579657:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.579676:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.579683:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a59d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400492.579801:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2359:x1873176368834432:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 19949us (20310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400492.579810:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:0.0:1786400492.583559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.583789:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368834816 00000100:00100000:2.0:1786400492.583800:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368834816 00000100:00100000:2.0:1786400492.583862:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 127 00000100:00100000:2.0:1786400492.583872:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:10532:x1873176368834816:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786400492.583946:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.583962:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.583973:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.584171:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.584182:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.584190:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.584235:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.584248:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 15 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.584262:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392965120:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400492.584324:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff937381254480 going to sleep for 11 seconds 00000100:00100000:0.0:1786400492.588630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.588725:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368834944 00000100:00100000:1.0:1786400492.588735:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368834944 00010000:00010000:1.0:1786400492.588808:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 16 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.588855:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:1.0:1786400492.588865:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:2362:x1873176368834944:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400492.588879:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400492.588886:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 16 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.588899:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 16 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.588922:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:1.0:1786400492.588928:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.588938:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.588946:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.588963:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400492.589026:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+16:2362:x1873176368834944:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 162us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400492.589041:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00010000:00010000:2.0:1786400492.589373:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f524e expref: 15 pid: 5818 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.589390:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392965120:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400492.589412:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.589420:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.589427:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400492.589631:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1786400492.589830:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1786400492.589873:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1786400492.589950:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392965248:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786400492.590202:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400492.590241:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388bcba80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400492.590337:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392965248 00000100:00100000:3.0:1786400492.590345:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392965248 00000100:00100000:3.0:1786400492.590397:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400492.590404:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5817:x1873176392965248:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786400492.590470:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5817:x1873176392965248:12345-0@lo:1000:mdt00_001.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400492.590476:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786400492.591893:0:5817:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1786400492.591902:0:5817:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b9112680, transno 4294967310 00000004:00080000:2.0:1786400492.591919:0:5817:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b9111180, transno 4294967311 00000100:00100000:2.0:1786400492.591926:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392965248:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1786400492.593239:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1786400492.593323:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392965376:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786400492.593380:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400492.593409:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400492.595453:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392965376 00000100:00100000:3.0:1786400492.595465:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392965376 00000100:00100000:3.0:1786400492.595521:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400492.595541:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5817:x1873176392965376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786400492.595883:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5817:x1873176392965376:12345-0@lo:1000:mdt00_001.0 Request processed in 344us (2502us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1786400492.595892:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786400492.596217:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392965376:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786400492.596257:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596268:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596276:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596281:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400492.596286:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596293:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596319:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9373850bf100) 00010000:00010000:0.0:1786400492.596322:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400492.596328:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596334:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a59de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596366:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596372:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596397:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596403:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c2176000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400492.596406:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596413:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596421:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400492.596424:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400492.596431:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5232 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596443:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5232 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596452:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5232 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.596485:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5232 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400492.596499:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79ca680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392965504:192.168.201.23@tcp:105: 00000100:00100000:0.0:1786400492.596587:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86600 going to sleep for 11 seconds 00000100:00100000:2.0:1786400492.600680:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79ca680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392965504:192.168.201.23@tcp:105: 00010000:00010000:2.0:1786400492.600710:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600721:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176000/0x49554f35ff0a5921 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600787:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600801:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600813:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600823:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600829:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600836:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600865:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400492.600870:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600877:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600889:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400492.600892:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400492.600895:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600901:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a59e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600911:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600917:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600922:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600926:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400492.600928:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600933:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600949:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400492.600952:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400492.600955:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.600961:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a59d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.601203:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:10532:x1873176368834816:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 17331us (17651us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1786400492.601213:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 127 00000020:00080000:2.0:1786400492.601219:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1786400492.601659:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400492.601665:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1786400492.602910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000040:00080000:0.0:1786400492.603671:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1786400492.603685:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786400492.604597:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368835072 00000100:00100000:2.0:1786400492.604610:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368835072 00000100:00100000:2.0:1786400492.604688:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:2.0:1786400492.604699:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:10531:x1873176368835072:12345-192.168.201.23@tcp:49:lfs.0 00000100:00100000:2.0:1786400492.604863:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:10531:x1873176368835072:12345-192.168.201.23@tcp:49:lfs.0 Request processed in 166us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.604871:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:3.0:1786400492.610850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400492.610927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400492.611447:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368835584 00000100:00100000:1.0:1786400492.611473:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368835584 00000100:00100000:1.0:1786400492.611538:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 128 00000100:00100000:1.0:1786400492.611547:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:10531:x1873176368835584:12345-192.168.201.23@tcp:58:lfs.0 00000100:00100000:2.0:1786400492.612610:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368835328 00000100:00100000:2.0:1786400492.612626:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368835328 00000100:00100000:2.0:1786400492.612665:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:2.0:1786400492.612673:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390269c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:10532:x1873176368835328:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1786400492.613765:0:8098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1786400492.613864:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:10531:x1873176368835584:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 2315us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400492.613874:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 128 00000004:00080000:0.0:1786400492.614956:0:5820:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786400492.615081:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1786400492.615144:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.615160:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.615172:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.615181:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.615187:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.615194:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400492.615220:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786400492.615290:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390269c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:10532:x1873176368835328:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 2616us (4460us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1786400492.615299:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000020:00080000:0.0:1786400492.615304:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400492.616700:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400492.616710:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.616720:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400492.616724:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.616732:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.616779:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93739128dc00) 00010000:00010000:1.0:1786400492.616783:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786400492.616787:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.616793:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a59ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400492.616813:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400492.616814:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400492.616816:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400492.655235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400492.655419:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368835712 00000100:00100000:3.0:1786400492.655429:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368835712 00000100:00100000:3.0:1786400492.655534:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 129 00000100:00100000:3.0:1786400492.655546:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:10534:x1873176368835712:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400492.655574:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400492.655603:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f526a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.655702:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.655736:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.655835:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.655862:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.655870:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.655878:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.656328:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.656342:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.656362:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.656415:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.656428:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 21 pid: 5817 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400492.656455:0:5816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1873176392965632:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400492.656574:0:5816:0:(client.c:2702:ptlrpc_set_wait()) set ffff937391168b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400492.666609:0:5816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1873176392965632:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400492.666647:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400492.667804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400492.668316:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368835968 00000100:00100000:0.0:1786400492.668324:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368835968 00000100:00100000:0.0:1786400492.668386:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1786400492.668396:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:5576:x1873176368835968:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786400492.668649:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:5576:x1873176368835968:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 253us (848us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1786400492.668657:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1786400492.671080:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400492.671250:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368836096 00000100:00100000:2.0:1786400492.671260:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368836096 00010000:00010000:2.0:1786400492.671297:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 23 pid: 5817 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400492.671356:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:2.0:1786400492.671365:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:2361:x1873176368836096:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400492.671380:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400492.671387:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 23 pid: 5817 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.671401:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 23 pid: 5817 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.671421:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373c2176200/0x49554f35ff0a5913 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f522b expref: 23 pid: 5817 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.671439:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:2.0:1786400492.671444:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.671455:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.671462:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400492.671493:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400492.671553:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:2361:x1873176368836096:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 189us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400492.671560:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00010000:00010000:3.0:1786400492.671630:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671639:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400492.671685:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1786400492.671689:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400492.671710:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671723:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671735:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671783:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671789:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671796:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400492.671808:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671817:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671827:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:3.0:1786400492.671830:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400492.671833:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671840:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a59fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671852:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671859:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671865:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671870:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400492.671873:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671879:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671886:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9373a3445700) 00010000:00010000:3.0:1786400492.671888:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400492.671896:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671902:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671935:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a59f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f526a expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671949:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f526a expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400492.671956:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400492.671959:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400492.671961:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763c00, rc 0) 00000100:00100000:3.0:1786400492.671986:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:10534:x1873176368835712:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 16444us (16762us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400492.672004:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 129 00010000:00010000:1.0:1786400492.693832:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786400493.460857:0:11943:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400493.460866:0:11943:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400493.460924:0:11943:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1786400493.460929:0:11943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786400493.474339:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400493.475271:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400493.475294:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392966144:0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.475377:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400493.475446:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392966144 00000100:00100000:1.0:1786400493.475452:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392966144 00000100:00100000:1.0:1786400493.475498:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786400493.475516:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392966144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.475571:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392966144:12345-0@lo:400:kworker.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400493.475577:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786400493.475632:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392966144:0@lo:400:kworker.0 00000100:00100000:0.0:1786400493.477199:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392966016:0@lo:400:kworker.0 00000100:00100000:0.0:1786400493.477255:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400493.477296:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400493.477303:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392965888:0@lo:400:kworker.0 00000100:00100000:0.0:1786400493.477325:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400493.477911:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392966016 00000100:00100000:1.0:1786400493.477920:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392966016 00000100:00100000:1.0:1786400493.477968:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392965888 00000100:00100000:1.0:1786400493.477971:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392965888 00000100:00100000:1.0:1786400493.477998:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1786400493.478007:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392966016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.478086:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392966016:12345-0@lo:400:kworker.0 Request processed in 80us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400493.478094:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1786400493.478109:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1786400493.478116:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392965888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.478155:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392965888:12345-0@lo:400:kworker.0 Request processed in 39us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400493.478160:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1786400493.478178:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400493.478212:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392965888:0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.478224:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392966016:0@lo:400:kworker.0 00000100:00100000:3.0:1786400493.478819:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392965760:0@lo:400:kworker.0 00000100:00100000:3.0:1786400493.478863:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400493.478888:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392965760 00000100:00100000:3.0:1786400493.478893:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392965760 00000100:00100000:3.0:1786400493.478921:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1786400493.478928:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392965760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400493.478959:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392965760:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400493.478965:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1786400493.479030:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392965760:0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.484707:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392966272:0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.484801:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400493.484847:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400493.484855:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392966400:0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.484884:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400493.484915:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392966400 00000100:00100000:1.0:1786400493.484922:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392966400 00000100:00100000:1.0:1786400493.484975:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786400493.484985:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1873176392966400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.486803:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1873176392966400:12345-0@lo:400:kworker.0 Request processed in 1812us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400493.486819:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1786400493.486853:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400493.486868:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392966272 00000100:00100000:1.0:1786400493.486874:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392966272 00000100:00100000:1.0:1786400493.486922:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1786400493.486929:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392966272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400493.486974:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392966272:12345-0@lo:400:kworker.0 Request processed in 43us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400493.486980:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1786400493.487231:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400493.488444:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392966272:0@lo:400:kworker.0 00000100:00100000:2.0:1786400493.491849:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392966400:0@lo:400:kworker.0 00000040:00080000:3.0:1786400493.657872:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400493.657882:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400493.657916:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1786400493.657922:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786400493.659266:0:11579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a01f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392966528:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400493.659768:0:11579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373911680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400493.671732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400493.671835:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368836224 00000100:00100000:3.0:1786400493.671844:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368836224 00000100:00100000:3.0:1786400493.671899:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00100000:3.0:1786400493.671909:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:10546:x1873176368836224:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786400493.671941:0:5816:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786400493.672229:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:10546:x1873176368836224:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 320us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400493.672239:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00100000:1.0:1786400493.676039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400493.676283:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368836480 00000100:00100000:3.0:1786400493.676303:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368836480 00000100:00100000:3.0:1786400493.676363:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 131 00000100:00100000:3.0:1786400493.676373:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:10546:x1873176368836480:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400493.676397:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400493.676419:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5271 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.676529:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.676571:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.676584:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400493.676596:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1786400493.676728:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5271 expref: 25 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.676789:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5271 expref: 24 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.676799:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400493.676802:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400493.676805:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763e00, rc 0) 00000100:00100000:3.0:1786400493.676862:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:10546:x1873176368836480:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 491us (833us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1786400493.676870:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 131 00000100:00100000:1.0:1786400493.679554:0:11579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a01f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392966528:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786400493.682399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400493.683168:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368836608 00000100:00100000:3.0:1786400493.683179:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368836608 00000100:00100000:3.0:1786400493.683249:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1786400493.683259:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:2361:x1873176368836608:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400493.683274:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400493.683310:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5271 expref: 23 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.683353:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400493.683358:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400493.683418:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:2361:x1873176368836608:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 159us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400493.683425:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:1.0:1786400493.688144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400493.688277:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368836864 00000100:00100000:3.0:1786400493.688287:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368836864 00000100:00100000:3.0:1786400493.688355:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 132 00000100:00100000:3.0:1786400493.688365:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:10546:x1873176368836864:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786400493.688448:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688464:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688476:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688713:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688722:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688727:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688732:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400493.688769:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688777:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688789:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400493.688792:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786400493.688796:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400493.688801:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400493.688947:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:10546:x1873176368836864:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 583us (812us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1786400493.688955:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 132 00000040:00080000:3.0:1786400493.690992:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400493.691002:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400493.694207:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786400493.694224:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400493.698246:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400493.698735:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368837120 00000100:00100000:2.0:1786400493.701187:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368837120 00000100:00100000:2.0:1786400493.701273:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:2.0:1786400493.701283:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:10546:x1873176368837120:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786400493.703226:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:10546:x1873176368837120:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1933us (4979us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1786400493.703240:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00010000:00010000:1.0:1786400493.717696:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400493.973784:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392966656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400493.973861:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400493.974275:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392966656 00000100:00100000:3.0:1786400493.974283:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392966656 00000100:00100000:3.0:1786400493.974347:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786400493.974357:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1873176392966656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400493.974390:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400493.974437:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1873176392966656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400493.974445:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786400493.974618:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392966656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400494.756292:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400494.885965:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400494.886006:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400494.886040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400494.886063:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400494.886097:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400494.886124:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368837376 00000100:00100000:1.0:1786400494.886134:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368837376 00000100:00100000:1.0:1786400494.886378:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368837760 00000100:00100000:1.0:1786400494.886383:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368837760 00000100:00100000:1.0:1786400494.886406:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 151 00000100:00100000:1.0:1786400494.886416:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:2361:x1873176368837376:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400494.886515:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:2361:x1873176368837376:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 100us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400494.886523:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 151 00000100:00100000:1.0:1786400494.886544:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 152 00000100:00100000:1.0:1786400494.886551:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368837760:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400494.886595:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368837760:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 44us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400494.886602:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 152 00000100:00100000:1.0:1786400494.886628:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368837504 00000100:00100000:1.0:1786400494.886632:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368837504 00000100:00100000:1.0:1786400494.886658:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368837632 00000100:00100000:1.0:1786400494.886661:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368837632 00000100:00100000:1.0:1786400494.886683:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:1.0:1786400494.886689:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368837504:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400494.886714:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368837504:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400494.886721:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:1.0:1786400494.886732:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:1.0:1786400494.886767:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368837632:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400494.886790:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368837632:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 52us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400494.886796:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00080000:1.0:1786400494.886811:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400494.886815:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400494.886818:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400494.889507:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368837248 00000100:00100000:3.0:1786400494.889536:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368837248 00000100:00100000:3.0:1786400494.889628:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 294 00000100:00100000:3.0:1786400494.889639:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368837248:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400494.889725:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368837248:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 88us (3781us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400494.889734:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 294 00000100:00100000:3.0:1786400495.025836:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392966784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400495.025917:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400495.026022:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392966784 00000100:00100000:3.0:1786400495.026386:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392966784 00000100:00100000:3.0:1786400495.026491:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786400495.026501:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937384f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392966784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400495.026546:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400495.026600:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937384f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392966784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400495.026607:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786400495.026867:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392966784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786400495.027160:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786400495.766882:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786400495.964625:0:11994:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400495.964634:0:11994:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400495.964680:0:11994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1786400495.964686:0:11994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1786400496.081426:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1786400496.081443:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1786400496.081448:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1786400496.095014:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400496.095119:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368838016 00000100:00100000:3.0:1786400496.095131:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368838016 00000100:00100000:3.0:1786400496.095200:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 133 00000100:00100000:3.0:1786400496.095209:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:10567:x1873176368838016:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400496.095228:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400496.095245:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5278 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.095328:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.095345:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.095354:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400496.095363:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1786400496.095459:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5278 expref: 27 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.095487:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5278 expref: 26 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.095499:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400496.095503:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1786400496.095506:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763e00, rc 0) 00000100:00080000:1.0:1786400496.095606:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400496.095715:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:10567:x1873176368838016:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 505us (709us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1786400496.095723:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 133 00000100:00100000:1.0:1786400496.100363:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400496.100450:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368838144 00000100:00100000:3.0:1786400496.100459:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368838144 00000100:00100000:3.0:1786400496.100611:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 134 00000100:00100000:3.0:1786400496.100622:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:10567:x1873176368838144:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:3.0:1786400496.100696:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100713:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100754:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100781:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100788:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100794:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100800:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400496.100804:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100811:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100822:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:3.0:1786400496.100825:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400496.100829:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400496.100834:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400496.100900:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:10567:x1873176368838144:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 279us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400496.100908:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 134 00000100:00100000:1.0:1786400496.173955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400496.174069:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368838272 00000100:00100000:2.0:1786400496.174079:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368838272 00000100:00080000:1.0:1786400496.174133:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400496.174193:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:2.0:1786400496.174201:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2360:x1873176368838272:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:2.0:1786400496.174216:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400496.174232:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a5a47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f527f expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400496.174251:0:6622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a7a4eeb, atime: 0x6a7a4eeb, ctime: 0x6a7a4eeb, blocks: 0xb 00010000:00010000:2.0:1786400496.174266:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1786400496.174270:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400496.174276:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a5a47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f527f expref: 7 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400496.174289:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a5a47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f527f expref: 7 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400496.174307:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f400, rc 0) 00000100:00100000:2.0:1786400496.174365:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2360:x1873176368838272:12345-192.168.201.23@tcp:101:cat.0 Request processed in 165us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400496.174373:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:1.0:1786400496.177715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400496.177865:0:6629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368838400 00000100:00100000:2.0:1786400496.177875:0:6629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368838400 00002000:00100000:2.0:1786400496.177927:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9373b8f45500 x1873176368838400/t0(0) o3->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:292/0 lens 488/0 e 0 to 0 dl 1786400507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400496.177938:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b8f45500 with x1873176368838400 ext(0->4095) 00002000:00010000:2.0:1786400496.177944:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b8f45500 00000100:00100000:2.0:1786400496.177985:0:6629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:2.0:1786400496.177996:0:6629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368838400:12345-192.168.201.23@tcp:3:cat.0 00000100:00100000:2.0:1786400496.178305:0:6629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368838400:12345-192.168.201.23@tcp:3:cat.0 Request processed in 311us (597us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786400496.178314:0:6629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00002000:00100000:2.0:1786400496.178320:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9373b8f45500 x1873176368838400/t0(0) o3->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:292/0 lens 488/4536 e 0 to 0 dl 1786400507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400496.178329:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b8f45500 with x1873176368838400 ext(0->4095) 00002000:00010000:2.0:1786400496.178828:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b8f45500 00010000:00010000:0.0:1786400496.787047:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786400497.653823:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:1.0:1786400497.653845:0:5839:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1786400497.653857:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1786400497.653869:0:5839:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff937390bc6600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1786400497.653874:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff93738d6b3600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff937390bc63c0 00000020:00080000:1.0:1786400497.653877:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff93738d6b3900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9373bfe3c400 00000001:00080000:1.0:1786400497.653891:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1786400497.653911:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1786400497.654083:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1786400497.660138:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1786400497.660154:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:0.0:1786400497.810947:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400498.581029:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392966912:0@lo:400:kworker.0 00000100:00100000:1.0:1786400498.581114:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400498.581213:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392966912 00000100:00100000:2.0:1786400498.581221:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392966912 00000100:00100000:2.0:1786400498.581284:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1786400498.581294:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392966912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.585910:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392967040:0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.585992:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400498.586044:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400498.586051:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392967168:0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.586073:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400498.586104:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392967296:0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.586133:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400498.586167:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392967040 00000100:00100000:3.0:1786400498.586175:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392967040 00000100:00100000:3.0:1786400498.586217:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392967168 00000100:00100000:3.0:1786400498.586220:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392967168 00000100:00100000:3.0:1786400498.586248:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1786400498.586257:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392967040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.586311:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392967040:12345-0@lo:400:kworker.0 Request processed in 54us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400498.586319:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1786400498.586336:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1786400498.586342:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392967168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.586370:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392967168:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400498.586376:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1786400498.586416:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392967168:0@lo:400:kworker.0 00000100:00100000:1.0:1786400498.588164:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392967296 00000100:00100000:1.0:1786400498.588176:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392967296 00000100:00100000:1.0:1786400498.588239:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1786400498.588248:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392967296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400498.588331:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392967296:12345-0@lo:400:kworker.0 Request processed in 85us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400498.588339:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1786400498.588363:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400498.588367:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400498.588397:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1786400498.588403:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1786400498.588437:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392967296:0@lo:400:kworker.0 00000100:00100000:2.0:1786400498.590963:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392966912:12345-0@lo:400:kworker.0 Request processed in 9659us (9836us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400498.590978:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1786400498.596035:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400498.596064:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392967424:0@lo:400:kworker.0 00000100:00100000:2.0:1786400498.596140:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400498.596267:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392967424 00000100:00100000:0.0:1786400498.596275:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392967424 00000100:00100000:0.0:1786400498.596350:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1786400498.596359:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392967424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400498.596417:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176392967424:12345-0@lo:400:kworker.0 Request processed in 59us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400498.596437:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1786400498.597727:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400498.597835:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392967424:0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.598617:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392967040:0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.598653:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392967552:0@lo:400:kworker.0 00000100:00100000:3.0:1786400498.598735:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400498.598889:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392967552 00000100:00100000:2.0:1786400498.598896:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392967552 00000100:00100000:2.0:1786400498.598972:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786400498.598983:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392967552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400498.599043:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392967552:12345-0@lo:400:kworker.0 Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400498.599050:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786400498.599079:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1786400498.599084:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1786400498.599101:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b79c7b80, transno 4294967304 00000100:00100000:2.0:1786400498.599112:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392967552:0@lo:400:kworker.0 00000100:00080000:3.0:1786400498.599821:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400498.600713:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392966912:0@lo:400:kworker.0 00000040:00080000:0.0:1786400498.837007:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400498.837016:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400498.837056:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1786400498.837064:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786400498.838275:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400499.091065:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400499.091090:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392967680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400499.091172:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400499.091460:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392967680 00000100:00100000:1.0:1786400499.091493:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392967680 00000100:00100000:1.0:1786400499.091548:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786400499.091557:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392967680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400499.091594:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400499.091654:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392967680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400499.091662:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786400499.091796:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392967680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400499.859603:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400500.002376:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400500.002448:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400500.002487:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400500.002506:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400500.002537:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400500.002979:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368838528 00000100:00100000:0.0:1786400500.002990:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368838528 00000100:00100000:0.0:1786400500.003059:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 296 00000100:00100000:0.0:1786400500.003068:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368838528:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400500.003133:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368838528:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 67us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400500.003140:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 296 00000100:00100000:2.0:1786400500.003245:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368838784 00000100:00100000:2.0:1786400500.003249:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368838784 00000100:00100000:2.0:1786400500.003315:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368838912 00000100:00100000:2.0:1786400500.003319:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368838912 00000100:00100000:2.0:1786400500.003340:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:2.0:1786400500.003348:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368838784:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400500.003373:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368839040 00000100:00100000:1.0:1786400500.003379:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368839040 00000100:00100000:2.0:1786400500.003380:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368838784:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 32us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400500.003388:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:2.0:1786400500.003414:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:2.0:1786400500.003421:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368838912:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400500.003443:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368838912:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 23us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400500.003448:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:2.0:1786400500.003489:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368838656 00000100:00100000:2.0:1786400500.003492:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368838656 00000100:00100000:2.0:1786400500.003518:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 156 00000100:00100000:2.0:1786400500.003538:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:2362:x1873176368838656:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400500.003614:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 157 00000100:00100000:1.0:1786400500.003623:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368839040:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400500.003652:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2362:x1873176368839040:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400500.003658:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 157 00000100:00080000:0.0:1786400500.003818:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400500.003823:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400500.003826:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400500.004331:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:2362:x1873176368838656:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 804us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400500.004339:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 156 00000100:00100000:1.0:1786400500.120252:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400500.120280:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392967808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400500.120352:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400500.120425:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392967808 00000100:00100000:1.0:1786400500.120433:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392967808 00000100:00100000:1.0:1786400500.120479:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786400500.120487:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392967808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400500.120535:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400500.120576:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392967808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400500.120582:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786400500.120626:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392967808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786400500.121114:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786400500.882938:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400501.194474:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400501.197070:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368839168 00000100:00100000:1.0:1786400501.197088:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368839168 00000100:00100000:1.0:1786400501.197153:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 135 00000100:00100000:1.0:1786400501.197164:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:10219:x1873176368839168:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786400501.197290:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:10219:x1873176368839168:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 127us (2829us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400501.197298:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 135 00000100:00100000:1.0:1786400501.205201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400501.207585:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368839424 00000100:00100000:2.0:1786400501.207600:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368839424 00000100:00100000:2.0:1786400501.207787:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:2.0:1786400501.207800:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:10219:x1873176368839424:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786400501.208284:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:10219:x1873176368839424:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 486us (3092us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1786400501.208301:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:2.0:1786400501.603114:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400501.603179:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368839552 00000100:00100000:0.0:1786400501.603191:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368839552 00000100:00100000:0.0:1786400501.603258:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 136 00000100:00100000:0.0:1786400501.603268:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:11019:x1873176368839552:12345-192.168.201.23@tcp:101:lsof.0 00010000:00010000:0.0:1786400501.603289:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400501.603318:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5286 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400501.603390:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400501.603899:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400501.603916:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400501.604126:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786400501.604131:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400501.604240:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400501.604271:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400501.604290:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400501.604311:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:0.0:1786400501.604314:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400501.604318:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030600, rc 0) 00000100:00100000:0.0:1786400501.604397:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:11019:x1873176368839552:12345-192.168.201.23@tcp:101:lsof.0 Request processed in 1130us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400501.604405:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 136 00010000:00010000:0.0:1786400501.907332:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786400502.745673:0:5839:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1786400502.745718:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1786400502.745855:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1786400502.745866:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1786400502.932219:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400503.700813:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400503.701424:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392968192:0@lo:400:kworker.0 00000100:00100000:1.0:1786400503.701424:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392968064:0@lo:400:kworker.0 00000100:00100000:0.0:1786400503.703387:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392968320:0@lo:400:kworker.0 00000100:00100000:1.0:1786400503.703511:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400503.703611:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392968064 00000100:00100000:1.0:1786400503.703619:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392968064 00000100:00100000:1.0:1786400503.703668:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1786400503.703676:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392968064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400503.703736:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392968064:12345-0@lo:400:kworker.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400503.703759:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1786400503.704031:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392968064:0@lo:400:kworker.0 00000100:00100000:3.0:1786400503.705091:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400503.705230:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392968192 00000100:00100000:1.0:1786400503.705236:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392968192 00000100:00100000:1.0:1786400503.705368:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1786400503.705377:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392968192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786400503.705477:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400503.705660:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392968192:12345-0@lo:400:kworker.0 Request processed in 284us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400503.705667:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1786400503.705768:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392968192:0@lo:400:kworker.0 00000100:00100000:1.0:1786400503.705960:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392968448:0@lo:400:kworker.0 00000100:00100000:1.0:1786400503.705997:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400503.706073:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400503.706077:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392968448 00000100:00100000:3.0:1786400503.706082:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392968576:0@lo:400:kworker.0 00000100:00100000:2.0:1786400503.706082:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392968448 00000100:00100000:3.0:1786400503.706110:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400503.706123:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1786400503.706130:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392968448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400503.706137:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392968576 00000100:00100000:3.0:1786400503.706141:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392968576 00000100:00100000:2.0:1786400503.706167:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392968448:12345-0@lo:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400503.706169:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786400503.706174:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786400503.706175:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392968576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400503.706209:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392968576:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400503.706215:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786400503.706221:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392968576:0@lo:400:kworker.0 00000100:00080000:1.0:1786400503.706283:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400503.706287:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400503.706304:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392968448:0@lo:400:kworker.0 00000100:00100000:0.0:1786400503.707406:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400503.707500:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392967936:0@lo:400:kworker.0 00000100:00100000:0.0:1786400503.707547:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400503.707622:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392967936 00000100:00100000:3.0:1786400503.707629:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392967936 00000100:00100000:3.0:1786400503.707709:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1786400503.707717:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392967936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400503.707861:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3315:x1873176392967936:12345-0@lo:400:kworker.0 Request processed in 144us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400503.707867:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1786400503.707947:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e769e6f-cf99-4814-98f1-5b8d54010374:3315:1873176392967936:0@lo:400:kworker.0 00000100:00100000:2.0:1786400503.709936:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392968320 00000100:00100000:2.0:1786400503.709949:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392968320 00000100:00100000:2.0:1786400503.710100:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786400503.710112:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392968320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400503.710196:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392968320:12345-0@lo:400:kworker.0 Request processed in 88us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400503.710203:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786400503.711964:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392968320:0@lo:400:kworker.0 00000100:00080000:1.0:1786400503.712527:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400503.955944:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400504.212413:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400504.214028:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392968704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400504.214115:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400504.214776:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392968704 00000100:00100000:1.0:1786400504.214785:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392968704 00000100:00100000:1.0:1786400504.214843:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786400504.214852:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392968704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400504.214889:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400504.214947:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392968704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400504.214955:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786400504.219900:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392968704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786400504.981798:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400505.127401:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400505.127443:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400505.127481:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400505.127506:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400505.127528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400505.127566:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368839808 00000100:00100000:2.0:1786400505.127577:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368839808 00000100:00100000:2.0:1786400505.127630:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368840192 00000100:00100000:2.0:1786400505.127633:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368840192 00000100:00100000:2.0:1786400505.127653:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 161 00000100:00100000:2.0:1786400505.127662:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:2362:x1873176368839808:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400505.127761:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:2362:x1873176368839808:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 74us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400505.127770:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 161 00000100:00100000:2.0:1786400505.127787:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 162 00000100:00100000:2.0:1786400505.127794:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2361:x1873176368840192:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400505.127818:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2361:x1873176368840192:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400505.127823:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 162 00000100:00100000:2.0:1786400505.127840:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368839936 00000100:00100000:2.0:1786400505.127843:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368839936 00000100:00100000:2.0:1786400505.127865:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368840064 00000100:00100000:2.0:1786400505.127867:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368840064 00000100:00100000:2.0:1786400505.127882:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:2.0:1786400505.127887:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368839936:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400505.127908:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368839936:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 20us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400505.127914:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:2.0:1786400505.127923:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:2.0:1786400505.127928:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368840064:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400505.127944:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368840064:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 16us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400505.127955:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00080000:2.0:1786400505.127973:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400505.127976:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786400505.127978:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400505.128570:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368839680 00000100:00100000:3.0:1786400505.128577:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368839680 00000100:00100000:3.0:1786400505.128624:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 298 00000100:00100000:3.0:1786400505.128632:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368839680:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400505.128678:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368839680:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 47us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400505.128685:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 298 00000100:00100000:2.0:1786400505.235000:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392968832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400505.235076:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400505.235236:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392968832 00000100:00100000:3.0:1786400505.235245:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392968832 00000100:00100000:3.0:1786400505.235317:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786400505.235326:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392968832:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786400505.235433:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1786400505.235481:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400505.235530:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392968832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400505.235537:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786400505.235601:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392968832:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1786400505.699707:0:12197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:21:44 (1786400504) 00010000:00010000:0.0:1786400506.008166:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400507.029363:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400507.068034:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400507.068147:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368840448 00000100:00100000:3.0:1786400507.068158:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368840448 00000100:00100000:3.0:1786400507.068245:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 137 00000100:00100000:3.0:1786400507.068257:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:11284:x1873176368840448:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400507.068310:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400507.068332:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f528d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.068429:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.068444:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.068455:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.068471:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.068478:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.068485:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786400507.068919:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786400507.069447:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5a71 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.069462:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5a71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.069471:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5a71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400507.069484:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1786400507.072263:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072297:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072322:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072329:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400507.072335:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072344:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072361:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93739128de00) 00010000:00010000:3.0:1786400507.072365:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400507.072370:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072378:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5a63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072395:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072402:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072409:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072415:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400507.072418:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072436:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072446:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9373a3445700) 00010000:00010000:3.0:1786400507.072448:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400507.072452:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.072458:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5a6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.073444:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f528d expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.073468:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5a71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f528d expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.073476:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:3.0:1786400507.073479:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400507.073483:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763200, rc 0) 00000100:00100000:3.0:1786400507.073795:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:11284:x1873176368840448:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 5538us (5769us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1786400507.073807:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 137 00000100:00100000:2.0:1786400507.079804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400507.079856:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400507.079931:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368840576 00000100:00100000:0.0:1786400507.079941:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368840576 00000100:00100000:0.0:1786400507.080002:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 138 00000100:00100000:0.0:1786400507.080012:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:11284:x1873176368840576:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786400507.080143:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:11284:x1873176368840576:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 132us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400507.080151:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 138 00000100:00100000:3.0:1786400507.080482:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368840704 00000100:00100000:3.0:1786400507.080487:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368840704 00000100:00100000:3.0:1786400507.080524:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:3.0:1786400507.080531:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:2359:x1873176368840704:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400507.080558:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400507.080584:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5a71 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f528d expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400507.080604:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:3.0:1786400507.080712:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400507.080763:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:2359:x1873176368840704:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 232us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400507.080769:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000001:00080000:1.0:1786400507.839380:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1786400508.050907:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786400508.051918:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400508.051925:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400508.052404:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1786400508.052412:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400508.821534:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392968960:0@lo:400:kworker.0 00000100:00100000:1.0:1786400508.821614:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400508.821657:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392969472:0@lo:400:kworker.0 00000100:00100000:1.0:1786400508.821692:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400508.821717:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400508.821722:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392969344:0@lo:400:kworker.0 00000100:00100000:2.0:1786400508.822080:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392969216:0@lo:400:kworker.0 00000100:00100000:3.0:1786400508.822232:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392969088:0@lo:400:kworker.0 00000100:00100000:2.0:1786400508.822430:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400508.824951:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392968960 00000100:00100000:2.0:1786400508.824967:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392968960 00000100:00100000:2.0:1786400508.825047:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1786400508.825058:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392968960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400508.825225:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392969472 00000100:00100000:0.0:1786400508.825230:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392969472 00000100:00100000:0.0:1786400508.825282:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392969216 00000100:00100000:0.0:1786400508.825285:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392969216 00000100:00100000:0.0:1786400508.825316:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1786400508.825324:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392969472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400508.825397:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392969472:12345-0@lo:400:kworker.0 Request processed in 74us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400508.825405:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1786400508.825422:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1786400508.825428:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392969216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400508.825460:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392969216:12345-0@lo:400:kworker.0 Request processed in 33us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400508.825472:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1786400508.825489:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400508.825529:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392969216:0@lo:400:kworker.0 00000100:00100000:2.0:1786400508.827582:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392968960:12345-0@lo:400:kworker.0 Request processed in 2519us (5960us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400508.827597:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1786400508.837913:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400508.838037:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392968960:0@lo:400:kworker.0 00000100:00100000:1.0:1786400508.838058:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392969472:0@lo:400:kworker.0 00000100:00100000:2.0:1786400508.839546:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400508.839589:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392969088 00000100:00100000:2.0:1786400508.839596:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392969088 00000100:00100000:2.0:1786400508.839643:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1786400508.839652:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392969088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400508.839706:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392969088:12345-0@lo:400:kworker.0 Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400508.839712:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1786400508.840133:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392969088:0@lo:400:kworker.0 00000100:00100000:2.0:1786400508.840144:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392969600:0@lo:400:kworker.0 00000100:00100000:2.0:1786400508.840177:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400508.846963:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392969344 00000100:00100000:0.0:1786400508.847039:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392969344 00000100:00080000:1.0:1786400508.847167:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400508.847405:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392969600 00000100:00100000:0.0:1786400508.847410:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392969600 00000100:00100000:0.0:1786400508.847457:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786400508.847468:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392969344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400508.847559:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392969344:12345-0@lo:400:kworker.0 Request processed in 94us (9653us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400508.847566:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786400508.847584:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1786400508.847590:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392969600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400508.847620:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392969600:12345-0@lo:400:kworker.0 Request processed in 31us (7443us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400508.847626:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1786400508.847713:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400508.847785:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392969344:0@lo:400:kworker.0 00000100:00100000:3.0:1786400508.847946:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392969600:0@lo:400:kworker.0 00000100:00100000:1.0:1786400509.026931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400509.027370:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368840832 00000100:00100000:0.0:1786400509.027381:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368840832 00000100:00100000:0.0:1786400509.027463:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 139 00000100:00100000:0.0:1786400509.027473:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:11326:x1873176368840832:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400509.027507:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400509.027532:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5a7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5294 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027601:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027628:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027641:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027657:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027664:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027671:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027932:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027938:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027943:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027947:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400509.027950:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027955:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027964:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:0.0:1786400509.027970:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400509.027974:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027978:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027986:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027990:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027994:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.027996:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400509.027998:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.028001:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.028005:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93739128d200) 00010000:00010000:0.0:1786400509.028006:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400509.028008:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.028011:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5a8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.028033:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5a7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5294 expref: 14 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.028049:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:0.0:1786400509.028051:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400509.028053:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5a7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5294 expref: 14 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.028060:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:0.0:1786400509.028125:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:11326:x1873176368840832:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 653us (1203us total) trans 0 rc 301/301 00000100:00100000:0.0:1786400509.028133:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 139 00000100:00080000:1.0:1786400509.028253:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400509.034010:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.034063:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368841088 00000100:00100000:3.0:1786400509.034073:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368841088 00000100:00100000:3.0:1786400509.034208:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 140 00000100:00100000:3.0:1786400509.034218:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:11326:x1873176368841088:12345-192.168.201.23@tcp:36:lfs.0 00010000:00010000:3.0:1786400509.034288:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400509.034379:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a53fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50cd expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.034395:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:3.0:1786400509.034400:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400509.034659:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.034674:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 5 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.034693:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.034724:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 5 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.034769:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 5 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.034787:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392969728:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400509.035257:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730480 going to sleep for 11 seconds 00000100:00100000:3.0:1786400509.038318:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.038361:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368841216 00000100:00100000:3.0:1786400509.038370:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368841216 00010000:00010000:3.0:1786400509.038424:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 6 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.038457:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:3.0:1786400509.038467:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2362:x1873176368841216:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400509.038482:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400509.038488:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 6 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.038501:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 6 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.038540:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:3.0:1786400509.038545:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.038554:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.038561:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.038580:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400509.038631:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2362:x1873176368841216:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 164us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400509.038639:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00080000:3.0:1786400509.038663:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786400509.038894:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5a55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5286 expref: 5 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400509.038911:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392969728:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400509.038929:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.038936:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.038942:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.038964:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.038973:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.038981:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400509.040111:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1786400509.040125:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.040133:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.040139:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.040144:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400509.040148:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.040156:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.040168:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf500) 00010000:00010000:2.0:1786400509.040171:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400509.040174:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.040179:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5a94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400509.040195:0:5818:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000857dac6f reply state 00000000e11ecf94 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400509.040204:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400509.040294:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:11326:x1873176368841088:12345-192.168.201.23@tcp:36:lfs.0 Request processed in 6075us (6288us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1786400509.040313:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 140 00010000:00010000:2.0:1786400509.044979:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.045000:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.045010:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.045016:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400509.045022:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.045031:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.045048:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff937386801600) 00010000:00010000:2.0:1786400509.045051:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400509.045056:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.045062:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5a9b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.074933:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400509.145704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.146013:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368841344 00000100:00100000:3.0:1786400509.146026:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368841344 00000100:00100000:3.0:1786400509.146414:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 141 00000100:00100000:3.0:1786400509.146427:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:11334:x1873176368841344:12345-192.168.201.23@tcp:101:lctl.0 00010000:00010000:3.0:1786400509.146454:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400509.146478:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5aa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f529b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.146543:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5aa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.146557:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.146587:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400509.146647:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786400509.146651:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400509.146677:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.146701:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5aa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f529b expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.146715:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f529b expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.146723:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:3.0:1786400509.146726:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400509.146730:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763000, rc 0) 00000100:00100000:3.0:1786400509.147035:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:11334:x1873176368841344:12345-192.168.201.23@tcp:101:lctl.0 Request processed in 608us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400509.147043:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 141 00000100:00100000:3.0:1786400509.210539:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400509.210721:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368841472 00000100:00100000:2.0:1786400509.210731:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368841472 00000100:00100000:2.0:1786400509.210830:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 142 00000100:00100000:2.0:1786400509.210840:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:11340:x1873176368841472:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400509.210875:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400509.210895:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52a2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.210959:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.210973:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.210984:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.210999:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211005:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211011:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211121:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211130:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211137:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400509.211168:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1786400509.211177:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400509.211211:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211301:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211309:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211316:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211321:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fc00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400509.211326:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211335:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211348:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:2.0:1786400509.211351:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400509.211355:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211362:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211376:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211382:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211398:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211404:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400509.211407:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211413:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211422:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff937386801600) 00010000:00010000:2.0:1786400509.211424:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400509.211427:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211433:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5abe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211465:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a2 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211478:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a2 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.211485:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400509.211487:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786400509.211489:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fe00, rc 0) 00000100:00100000:2.0:1786400509.211553:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:11340:x1873176368841472:12345-192.168.201.23@tcp:101:bash.0 Request processed in 714us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400509.211570:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 142 00000100:00100000:2.0:1786400509.216584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400509.216687:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368841728 00000100:00100000:0.0:1786400509.216698:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368841728 00000100:00100000:0.0:1786400509.217108:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 143 00000100:00100000:0.0:1786400509.217120:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+15:11340:x1873176368841728:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400509.217143:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400509.217164:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5acc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52a9 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.217423:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.217437:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.217447:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.217500:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.217521:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.217528:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786400509.218620:0:8098:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1786400509.219015:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219086:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219098:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219136:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219143:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219150:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219156:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400509.219160:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219167:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219192:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400509.219195:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400509.219200:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219206:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5ad3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400509.219300:0:8098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce33ad87 reply state 0000000086711e05 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400509.219311:0:8098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786400509.219474:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5acc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 18 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219494:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 17 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.219502:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:0.0:1786400509.219505:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400509.219510:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:0.0:1786400509.220715:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:11340:x1873176368841728:12345-192.168.201.23@tcp:101:bash.0 Request processed in 2547us (3338us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1786400509.220727:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 143 00000100:00100000:0.0:1786400509.225613:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400509.225802:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368841856 00000100:00100000:1.0:1786400509.225812:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368841856 00000100:00100000:1.0:1786400509.225883:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:1.0:1786400509.225894:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368841856:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1786400509.225912:0:11904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400509.225935:0:11904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52b0 expref: -99 pid: 11904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400509.225966:0:11904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786400509.225986:0:11904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786400509.225992:0:11904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400509.226001:0:11904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 6 pid: 11904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.226018:0:11904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 6 pid: 11904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.226047:0:11904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf000, rc 0) 00000100:00100000:1.0:1786400509.226115:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368841856:12345-192.168.201.23@tcp:101:bash.0 Request processed in 224us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400509.226123:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00080000:0.0:1786400509.226722:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786400509.227582:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.227595:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.227670:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.227694:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400509.227699:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.227707:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.227724:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93739128d200) 00010000:00010000:3.0:1786400509.227727:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400509.227732:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.227823:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ada lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.230390:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400509.230635:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368841984 00000100:00100000:0.0:1786400509.230644:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368841984 00000100:00100000:0.0:1786400509.230715:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1786400509.230725:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:11340:x1873176368841984:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400509.230774:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400509.230794:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52b7 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.230830:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 7 pid: 11904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.230839:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400509.230844:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400509.230849:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.230883:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 7 pid: 11904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.230896:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 7 pid: 11904 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400509.230908:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6624:1873176392969856:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400509.231004:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400509.236517:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6624:1873176392969856:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400509.236558:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.236612:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031e00, rc 0) 00000100:00100000:0.0:1786400509.236677:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:11340:x1873176368841984:12345-192.168.201.23@tcp:101:bash.0 Request processed in 5953us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400509.236687:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:2.0:1786400509.238394:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.238517:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368842112 00000100:00100000:3.0:1786400509.238526:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368842112 00010000:00010000:3.0:1786400509.238563:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 7 pid: 11904 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.238613:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:3.0:1786400509.238622:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368842112:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400509.238635:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400509.238657:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 7 pid: 11904 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.238688:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 7 pid: 11904 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.238713:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038f29de6/0x49554f35ff0a5aef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b0 expref: 7 pid: 11904 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.238731:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400509.238735:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400509.238795:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.238806:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.238846:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.238862:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b79caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1873176392969984:192.168.201.23@tcp:105: 00000100:00100000:3.0:1786400509.238933:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730180 going to sleep for 11 seconds 00000100:00100000:3.0:1786400509.243994:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400509.244268:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368842368 00000100:00100000:2.0:1786400509.244279:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368842368 00000100:00100000:2.0:1786400509.244343:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:2.0:1786400509.244352:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:11340:x1873176368842368:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:2.0:1786400509.244963:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:11340:x1873176368842368:12345-192.168.201.23@tcp:35:bash.0 Request processed in 609us (974us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1786400509.244972:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:0.0:1786400509.245221:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b79caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1873176392969984:192.168.201.23@tcp:105: 00010000:00010000:0.0:1786400509.245253:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400509.245276:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368842112:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 6655us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400509.245283:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:3.0:1786400509.331875:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400509.331902:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392970112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400509.331973:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400509.332156:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392970112 00000100:00100000:1.0:1786400509.332165:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392970112 00000100:00100000:1.0:1786400509.332221:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1786400509.332230:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392970112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400509.332278:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400509.332344:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392970112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400509.332351:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786400509.332443:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392970112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400509.361582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400509.361699:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368842624 00000100:00100000:2.0:1786400509.361709:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368842624 00000100:00100000:2.0:1786400509.361811:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 144 00000100:00100000:2.0:1786400509.361822:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:11350:x1873176368842624:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400509.361861:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400509.361884:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52be expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400509.362002:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1786400509.362129:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5afd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52be expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.362144:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:2.0:1786400509.362148:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400509.362164:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52be expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.362178:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fc00, rc 0) 00000100:00100000:2.0:1786400509.362252:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:11350:x1873176368842624:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 432us (682us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1786400509.362260:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 144 00000100:00100000:1.0:1786400509.381702:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.381832:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368842880 00000100:00100000:3.0:1786400509.381860:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368842880 00000100:00100000:3.0:1786400509.381925:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:3.0:1786400509.381936:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:11350:x1873176368842880:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400509.382207:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:11350:x1873176368842880:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 272us (514us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1786400509.382216:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:1.0:1786400509.505690:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.505780:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368843008 00000100:00100000:3.0:1786400509.505790:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368843008 00000100:00100000:3.0:1786400509.505853:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 145 00000100:00100000:3.0:1786400509.505863:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:11356:x1873176368843008:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400509.505889:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400509.505909:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52c5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.505976:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5b12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.505990:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.506003:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400509.506063:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1786400509.506068:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400509.506091:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.506117:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52c5 expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.506154:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52c5 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.506162:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:3.0:1786400509.506165:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400509.506168:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763800, rc 0) 00000100:00100000:3.0:1786400509.506226:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:11356:x1873176368843008:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 365us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400509.506244:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 145 00000100:00100000:0.0:1786400509.512066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400509.512246:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368843264 00000100:00100000:2.0:1786400509.512256:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368843264 00000100:00100000:2.0:1786400509.512324:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 146 00000100:00100000:2.0:1786400509.512335:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:11356:x1873176368843264:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400509.512356:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400509.512376:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5b19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52cc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.512488:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5b20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.512502:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.512514:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400509.512524:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1786400509.512649:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5b19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52cc expref: 24 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.512666:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52cc expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.512689:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:2.0:1786400509.512692:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400509.512696:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f200, rc 0) 00000100:00100000:2.0:1786400509.512806:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:11356:x1873176368843264:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 472us (750us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1786400509.512814:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 146 00000100:00100000:1.0:1786400509.517211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400509.517267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400509.517407:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368843648 00000100:00100000:0.0:1786400509.517416:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368843648 00000100:00100000:0.0:1786400509.517479:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 147 00000100:00100000:0.0:1786400509.517490:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:11356:x1873176368843648:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400509.517517:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400509.517539:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52d3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.517635:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.517649:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.517660:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400509.517688:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1786400509.517870:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52d3 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.517889:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52d3 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.517897:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:0.0:1786400509.517900:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786400509.517904:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031600, rc 0) 00000100:00100000:0.0:1786400509.517962:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+25:11356:x1873176368843648:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 473us (693us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1786400509.517970:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 147 00000100:00100000:3.0:1786400509.518676:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368843392 00000100:00100000:3.0:1786400509.518683:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368843392 00000100:00100000:3.0:1786400509.518734:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1786400509.518776:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+25:2361:x1873176368843392:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400509.518787:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400509.518805:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a5b20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52cc expref: 25 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.518818:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:3.0:1786400509.518822:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400509.519003:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:2361:x1873176368843392:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 228us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400509.519010:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:1.0:1786400509.524214:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400509.524336:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368843776 00000100:00100000:2.0:1786400509.524348:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368843776 00000100:00100000:2.0:1786400509.524412:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:2.0:1786400509.524423:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368843776:12345-192.168.201.23@tcp:1:lfs.0 00010000:00010000:2.0:1786400509.524474:0:6622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.524494:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.524504:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786400509.524508:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400509.524513:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.524550:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.524576:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 6 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400509.524615:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6622:1873176392970240:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400509.524706:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400509.529730:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400509.529863:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368843904 00000100:00100000:1.0:1786400509.529875:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368843904 00002000:00100000:1.0:1786400509.529931:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9373b7a1a300 x1873176368843904/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:305/0 lens 504/0 e 0 to 0 dl 1786400520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400509.529943:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b7a1a300 with x1873176368843904 ext(0->12) 00010000:00010000:1.0:1786400509.529952:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 7 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.529987:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 7 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400509.529995:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9373b7a1a300 00000100:00100000:1.0:1786400509.530031:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1786400509.530041:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368843904:12345-192.168.201.23@tcp:4:lfs.0 00000100:00100000:1.0:1786400509.530661:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2361:x1873176368843904:12345-192.168.201.23@tcp:4:lfs.0 Request processed in 619us (941us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1786400509.530670:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00002000:00100000:1.0:1786400509.530677:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9373b7a1a300 x1873176368843904/t4294967305(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:305/0 lens 504/448 e 0 to 0 dl 1786400520 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400509.530686:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b7a1a300 with x1873176368843904 ext(0->12) 00010000:00010000:1.0:1786400509.530692:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 9 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.530704:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 9 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400509.530711:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9373b7a1a300 00000100:00100000:2.0:1786400509.530893:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6622:1873176392970240:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400509.530917:0:6622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400509.533870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.533967:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368844032 00000100:00100000:3.0:1786400509.533978:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368844032 00010000:00010000:3.0:1786400509.534019:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 9 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.534078:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1786400509.534088:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2362:x1873176368844032:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400509.534106:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786400509.534124:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1786400509.534127:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786400509 00002000:00010000:3.0:1786400509.534129:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786400509 00002000:00010000:3.0:1786400509.534132:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1786400509 00010000:00010000:3.0:1786400509.534138:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 9 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.534152:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 9 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.534180:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a5af6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52b7 expref: 9 pid: 6624 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.534199:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400509.534203:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400509.534211:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.534220:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.534266:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400509.534338:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368844032:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 251us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400509.534346:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00010000:00010000:2.0:1786400509.534483:0:6622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.534493:0:6622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.534519:0:6622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.534527:0:6622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.534536:0:6622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.534542:0:6622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fc00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400509.534546:0:6622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.534566:0:6622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.534578:0:6622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.534585:0:6622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a5b43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400509.534635:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368843776:12345-192.168.201.23@tcp:1:lfs.0 Request processed in 10215us (10432us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400509.534644:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:0.0:1786400509.537629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.538069:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368844288 00000100:00100000:3.0:1786400509.538080:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368844288 00000100:00100000:3.0:1786400509.538172:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1786400509.538182:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390269850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11356:x1873176368844288:12345-192.168.201.23@tcp:35:lfs.0 00000004:00010000:3.0:1786400509.538259:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52d3 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786400509.538529:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1786400509.538575:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1786400509.539265:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1786400509.539881:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.539898:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 28 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.539907:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.539945:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 28 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.539961:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 28 pid: 8098 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.539977:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5820:1873176392970368:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400509.540119:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730180 going to sleep for 11 seconds 00000100:00100000:0.0:1786400509.545258:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400509.545330:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368844416 00000100:00100000:1.0:1786400509.545339:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368844416 00010000:00010000:1.0:1786400509.545381:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 29 pid: 8098 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.546014:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5820:1873176392970368:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400509.546042:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400509.546176:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:1.0:1786400509.546187:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:2361:x1873176368844416:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400509.546202:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400509.546210:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 29 pid: 8098 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.546220:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 29 pid: 8098 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.546255:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a9 expref: 29 pid: 8098 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.546272:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:1.0:1786400509.546277:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.546391:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.546400:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400509.546457:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400509.546511:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+28:2361:x1873176368844416:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 325us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400509.546519:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00010000:00010000:3.0:1786400509.547108:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.547116:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786400509.547250:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1786400509.548277:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1786400509.548462:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392970496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786400509.548529:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400509.548696:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392970496 00000100:00100000:2.0:1786400509.548704:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392970496 00000100:00100000:2.0:1786400509.548777:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400509.548787:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1873176392970496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786400509.548863:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1873176392970496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400509.548871:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786400509.548902:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730480 going to sleep for 11 seconds 00000100:00100000:3.0:1786400509.548929:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392970496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786400509.549361:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1786400509.549464:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392970624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786400509.549495:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400509.549580:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373908bb000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400509.549983:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392970624 00000100:00100000:2.0:1786400509.549989:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392970624 00000100:00100000:2.0:1786400509.550015:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400509.550023:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1873176392970624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786400509.550222:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5820:x1873176392970624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 198us (725us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1786400509.550249:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786400509.550484:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392970624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786400509.550536:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1786400509.550936:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.550948:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.550967:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.550972:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400509.550977:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.550985:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.551001:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:3.0:1786400509.551004:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786400509.551008:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.551015:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786400509.551191:0:5820:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1786400509.551306:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1786400509.551317:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431292577359ns, next at 432292575504ns, rc = 0 00000001:00080000:3.0:1786400509.551323:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1786400509.551553:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:3.0:1786400509.551557:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786400509.551698:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52d3 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400509.551934:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390269850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:11356:x1873176368844288:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 13752us (14313us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1786400509.551953:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000020:00080000:3.0:1786400509.551957:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1786400509.560116:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400509.561122:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368844544 00000100:00100000:2.0:1786400509.561134:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368844544 00000100:00100000:2.0:1786400509.561203:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 148 00000100:00100000:2.0:1786400509.561214:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:11356:x1873176368844544:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400509.561260:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400509.561374:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52da expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.561448:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52da expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.561465:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52da expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.561486:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400509.561490:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400509.561494:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fc00, rc 0) 00000100:00100000:2.0:1786400509.561555:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11356:x1873176368844544:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 343us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400509.561563:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 148 00000100:00100000:0.0:1786400509.565465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400509.565661:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368844800 00000100:00100000:2.0:1786400509.565672:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368844800 00000100:00100000:2.0:1786400509.565815:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:2.0:1786400509.565827:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11356:x1873176368844800:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400509.566074:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+33:11356:x1873176368844800:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 250us (618us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1786400509.566097:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:0.0:1786400509.640660:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.640783:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368845056 00000100:00100000:3.0:1786400509.640794:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368845056 00000100:00100000:3.0:1786400509.640862:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 149 00000100:00100000:3.0:1786400509.640872:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+33:11366:x1873176368845056:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400509.640899:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400509.640920:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52e1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400509.641032:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1786400509.641148:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e1 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.641164:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:3.0:1786400509.641167:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400509.641173:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5b58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e1 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.641187:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763200, rc 0) 00000100:00100000:3.0:1786400509.641272:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:11366:x1873176368845056:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 400us (621us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1786400509.641280:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 149 00000100:00100000:0.0:1786400509.649909:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.650013:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368845184 00000100:00100000:3.0:1786400509.650024:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368845184 00000100:00100000:3.0:1786400509.650087:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 150 00000100:00100000:3.0:1786400509.650096:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:11366:x1873176368845184:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:3.0:1786400509.650190:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650208:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650219:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650247:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650256:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650264:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650608:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650618:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650625:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786400509.650666:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.650678:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653578:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653587:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653594:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400509.653599:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653609:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653627:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:3.0:1786400509.653630:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400509.653635:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653641:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5b66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653659:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653665:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653670:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653675:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400509.653964:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653973:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653982:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373a3445200) 00010000:00010000:3.0:1786400509.653985:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400509.653988:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.653994:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.654013:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.654020:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.654026:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.654032:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400509.654035:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.654041:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.654048:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400509.654050:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400509.654060:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.654067:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400509.654277:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:11366:x1873176368845184:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 4176us (4372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400509.654298:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 150 00000100:00100000:0.0:1786400509.656617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.656704:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368845440 00000100:00100000:3.0:1786400509.656715:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368845440 00000100:00100000:3.0:1786400509.656853:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:3.0:1786400509.656863:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:11366:x1873176368845440:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400509.657121:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:11366:x1873176368845440:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 259us (511us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1786400509.657129:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:0.0:1786400509.689262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.689362:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368845696 00000100:00100000:3.0:1786400509.689373:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368845696 00000100:00100000:3.0:1786400509.689435:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 151 00000100:00100000:3.0:1786400509.689445:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:11369:x1873176368845696:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400509.689473:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400509.689496:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52e8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.689575:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.689590:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.689602:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.689636:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.689644:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.689652:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.689828:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.689837:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.690013:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400509.690025:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1786400509.691250:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691264:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691272:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691278:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400509.691348:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691358:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691373:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400509.691376:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400509.691381:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691387:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5b82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691404:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691425:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691430:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691435:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400509.691438:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691444:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691452:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373a3445200) 00010000:00010000:2.0:1786400509.691454:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400509.691457:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691464:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691518:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5b7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691534:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.691542:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400509.691544:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400509.691552:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031c00, rc 0) 00000100:00100000:2.0:1786400509.691675:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:11369:x1873176368845696:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 2230us (2425us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1786400509.691684:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 151 00000100:00100000:0.0:1786400509.694426:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400509.694523:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368845824 00000100:00100000:2.0:1786400509.694535:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368845824 00000100:00100000:2.0:1786400509.694639:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 152 00000100:00100000:2.0:1786400509.694649:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:11369:x1873176368845824:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:2.0:1786400509.694715:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694732:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694785:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694812:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694819:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694826:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694832:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400509.694837:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694857:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694881:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400509.694884:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400509.694888:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400509.694895:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5b9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400509.694963:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:11369:x1873176368845824:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 315us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400509.694971:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 152 00000100:00100000:1.0:1786400509.697459:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.697560:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368846080 00000100:00100000:3.0:1786400509.697569:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368846080 00000100:00100000:3.0:1786400509.697624:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:3.0:1786400509.697634:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:11369:x1873176368846080:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400509.697902:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:11369:x1873176368846080:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 268us (451us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1786400509.697910:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:1.0:1786400509.937491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400509.937621:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368846336 00000100:00100000:0.0:1786400509.937632:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368846336 00000100:00100000:0.0:1786400509.937793:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 153 00000100:00100000:0.0:1786400509.937805:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:11400:x1873176368846336:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:0.0:1786400509.937832:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400509.937862:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52ef expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.937964:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.937980:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.937992:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400509.938003:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1786400509.938135:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52ef expref: 41 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.938152:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52ef expref: 40 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400509.938162:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:0.0:1786400509.938165:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400509.938169:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48a00, rc 0) 00000100:00100000:0.0:1786400509.938286:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:11400:x1873176368846336:12345-192.168.201.23@tcp:101:cat.0 Request processed in 474us (797us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1786400509.938295:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 153 00000100:00100000:1.0:1786400509.941048:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.941179:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368846464 00000100:00100000:3.0:1786400509.941189:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368846464 00000100:00100000:3.0:1786400509.944514:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:3.0:1786400509.944551:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:2362:x1873176368846464:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400509.944571:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400509.944601:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52ef expref: 40 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400509.944622:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400509.944627:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400509.945282:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:2362:x1873176368846464:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 738us (4242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400509.945292:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:1.0:1786400509.946857:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400509.949329:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368846720 00000100:00100000:3.0:1786400509.949347:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368846720 00000100:00100000:3.0:1786400509.949438:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:3.0:1786400509.949449:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:11400:x1873176368846720:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:3.0:1786400509.949770:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:11400:x1873176368846720:12345-192.168.201.23@tcp:35:cat.0 Request processed in 290us (2896us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1786400509.949779:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:1.0:1786400510.011015:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.011159:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368846976 00000100:00100000:0.0:1786400510.011180:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368846976 00000100:00100000:0.0:1786400510.011241:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 154 00000100:00100000:0.0:1786400510.011252:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:11406:x1873176368846976:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:0.0:1786400510.011277:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400510.011341:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786400510.011370:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5b12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52c5 expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.011389:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400510.011394:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400510.011408:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5bba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.011488:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.011497:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.011502:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.011526:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.011535:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 40 pid: 5816 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400510.011545:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392970752:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400510.011685:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86780 going to sleep for 11 seconds 00000100:00100000:2.0:1786400510.017219:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392970752:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400510.017258:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400510.017341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400510.017415:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368847104 00000100:00100000:1.0:1786400510.017422:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368847104 00010000:00010000:1.0:1786400510.017462:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 41 pid: 5816 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400510.017495:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1786400510.017503:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+41:2361:x1873176368847104:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400510.017516:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400510.017523:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 41 pid: 5816 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.017534:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 41 pid: 5816 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.017553:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52e8 expref: 41 pid: 5816 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.017567:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:1.0:1786400510.017571:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.017580:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.017587:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.017622:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400510.017914:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:2361:x1873176368847104:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 229us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400510.017926:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00010000:00010000:2.0:1786400510.018016:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.018024:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400510.018043:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1786400510.018206:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5bba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 41 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.018231:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 40 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.018239:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400510.018247:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786400510.018250:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49000, rc 0) 00000100:00100000:2.0:1786400510.018276:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:11406:x1873176368846976:12345-192.168.201.23@tcp:101:dd.0 Request processed in 7026us (7271us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1786400510.018282:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 154 00000100:00100000:3.0:1786400510.022383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400510.022446:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368847360 00000100:00100000:2.0:1786400510.022457:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368847360 00000100:00100000:2.0:1786400510.022524:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 155 00000100:00100000:2.0:1786400510.022534:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:11406:x1873176368847360:12345-192.168.201.23@tcp:36:dd.0 00010000:00010000:2.0:1786400510.022897:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.022916:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.022929:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400510.022983:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1786400510.023009:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009465deb8 reply state 00000000657e8a9e transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400510.023019:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400510.023734:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:11406:x1873176368847360:12345-192.168.201.23@tcp:36:dd.0 Request processed in 1192us (1354us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1786400510.023787:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 155 00000020:00080000:2.0:1786400510.023793:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786400510.026555:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.026574:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.026595:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.026601:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400510.026606:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.026614:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.026633:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400510.026646:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400510.026651:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.026657:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.099142:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400510.240155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.240204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.240268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.240310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.240330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.240364:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368847744 00000100:00100000:0.0:1786400510.240374:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368847744 00000100:00100000:0.0:1786400510.240434:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368847872 00000100:00100000:0.0:1786400510.240438:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368847872 00000100:00100000:0.0:1786400510.240462:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:0.0:1786400510.240471:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2360:x1873176368847744:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400510.240547:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2360:x1873176368847744:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 76us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400510.240556:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:0.0:1786400510.240575:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00100000:0.0:1786400510.240581:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2360:x1873176368847872:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400510.240607:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2360:x1873176368847872:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400510.240614:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00080000:0.0:1786400510.240637:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400510.240728:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368847488 00000100:00100000:3.0:1786400510.240733:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368847488 00000100:00100000:3.0:1786400510.240803:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 300 00000100:00100000:3.0:1786400510.240811:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368847488:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400510.240854:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368847488:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 30us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400510.240861:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 300 00000100:00100000:1.0:1786400510.241112:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368848000 00000100:00100000:1.0:1786400510.241118:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368848000 00000100:00100000:1.0:1786400510.241154:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368847616 00000100:00100000:1.0:1786400510.241158:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368847616 00000100:00100000:1.0:1786400510.241179:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 166 00000100:00100000:1.0:1786400510.241187:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368848000:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400510.241231:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368848000:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 45us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400510.241237:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 166 00000100:00100000:1.0:1786400510.241251:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 167 00000100:00100000:1.0:1786400510.241257:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+42:2360:x1873176368847616:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400510.241285:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+42:2360:x1873176368847616:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400510.241291:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 167 00000100:00100000:0.0:1786400510.355448:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392970880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400510.355530:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400510.355710:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392970880 00000100:00100000:1.0:1786400510.355730:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392970880 00000100:00100000:1.0:1786400510.355871:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1786400510.355883:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392970880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400510.355926:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1786400510.356005:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400510.360683:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392970880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4782us (5133us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400510.360730:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1786400510.364814:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392970880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400510.486919:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400510.487092:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368848128 00000100:00100000:1.0:1786400510.487103:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368848128 00000100:00100000:1.0:1786400510.487182:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 156 00000100:00100000:1.0:1786400510.487193:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+42:11420:x1873176368848128:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:1.0:1786400510.487245:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400510.487269:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5bd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f52fd expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487468:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487483:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487496:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487510:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487517:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487524:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487621:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487632:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487654:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487689:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.487704:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 43 pid: 5818 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400510.487718:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b884c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392971008:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400510.487866:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aad80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400510.498660:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.499087:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368848384 00000100:00100000:0.0:1786400510.499100:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368848384 00000100:00100000:0.0:1786400510.499178:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:0.0:1786400510.499192:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+44:5576:x1873176368848384:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786400510.499568:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:5576:x1873176368848384:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 378us (917us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1786400510.499576:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:1.0:1786400510.504057:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400510.504562:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368848512 00000100:00100000:3.0:1786400510.504573:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368848512 00010000:00010000:3.0:1786400510.504616:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 45 pid: 5818 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400510.504656:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:3.0:1786400510.504676:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:2361:x1873176368848512:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400510.504691:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400510.504698:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 45 pid: 5818 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.504712:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 45 pid: 5818 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.504734:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400510.504783:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.504793:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.504801:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.504821:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400510.504885:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:2361:x1873176368848512:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 220us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400510.504912:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00010000:00010000:2.0:1786400510.515583:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5bc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52f6 expref: 44 pid: 5818 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400510.515613:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b884c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392971008:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400510.515641:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.515651:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.515657:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400510.516096:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1786400510.516101:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400510.516122:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.516138:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.516149:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.516156:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.516162:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.516168:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400510.518011:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518029:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518049:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400510.518052:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400510.518058:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518064:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a5bdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518105:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518111:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518117:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518123:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400510.518126:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518133:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518141:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373850bfc00) 00010000:00010000:2.0:1786400510.518143:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400510.518146:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518151:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a5be4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518207:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5bd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52fd expref: 44 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518232:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52fd expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.518250:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400510.518252:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400510.518255:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebfc00, rc 0) 00000100:00100000:0.0:1786400510.538756:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:11420:x1873176368848128:12345-192.168.201.23@tcp:101:stat.0 Request processed in 51531us (51814us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400510.538771:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 156 00000100:00100000:1.0:1786400510.678481:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400510.679531:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368848768 00000100:00100000:2.0:1786400510.679546:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368848768 00000100:00100000:2.0:1786400510.679636:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 157 00000100:00100000:2.0:1786400510.679648:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:11426:x1873176368848768:12345-192.168.201.23@tcp:36:truncate.0 00010000:00010000:2.0:1786400510.679711:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400510.679769:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5beb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52fd expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.679791:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400510.679797:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400510.680051:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.680067:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400510.680077:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400510.680136:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1786400510.680159:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d72fe5dd reply state 0000000094498942 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400510.680169:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400510.680280:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:11426:x1873176368848768:12345-192.168.201.23@tcp:36:truncate.0 Request processed in 633us (1810us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1786400510.680301:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 157 00000020:00080000:2.0:1786400510.680306:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400510.690128:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.690151:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.690160:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.690166:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400510.690172:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.690180:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.690239:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:1.0:1786400510.690242:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400510.690247:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400510.690254:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5bf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400510.882714:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400510.884041:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368848896 00000100:00100000:3.0:1786400510.884056:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368848896 00000100:00100000:3.0:1786400510.884192:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 158 00000100:00100000:3.0:1786400510.884204:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+44:11440:x1873176368848896:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:3.0:1786400510.884248:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400510.884282:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5bf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5304 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884355:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884372:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884385:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884410:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884418:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884425:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884533:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884561:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.884569:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400510.884608:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1786400510.884613:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400510.885138:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885152:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885161:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885167:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885173:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885179:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400510.885185:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885192:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885203:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:3.0:1786400510.885225:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400510.885231:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885238:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885253:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885258:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885264:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885270:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400510.885272:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885278:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885285:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373a3445100) 00010000:00010000:3.0:1786400510.885288:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400510.885290:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885296:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885330:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5bf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 46 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885354:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 45 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400510.885362:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400510.885364:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400510.885367:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031e00, rc 0) 00000100:00100000:3.0:1786400510.885462:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:11440:x1873176368848896:12345-192.168.201.23@tcp:101:stat.0 Request processed in 1259us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400510.885470:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 158 00000100:00100000:3.0:1786400510.988112:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.988304:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368849152 00000100:00100000:0.0:1786400510.988318:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368849152 00000100:00100000:0.0:1786400510.988387:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 159 00000100:00100000:0.0:1786400510.988405:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+45:11450:x1873176368849152:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400510.988425:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400510.988445:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a5c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f530b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400510.988558:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1786400510.988679:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a5c15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f530b expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.988693:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:0.0:1786400510.988696:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400510.988701:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a5c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f530b expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400510.988732:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48e00, rc 0) 00000100:00100000:0.0:1786400510.988864:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+46:11450:x1873176368849152:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 460us (761us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1786400510.988871:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 159 00000100:00100000:1.0:1786400510.993260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400510.993348:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368849408 00000100:00100000:0.0:1786400510.993359:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368849408 00000100:00100000:0.0:1786400510.993431:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:0.0:1786400510.993442:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390224c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+46:11450:x1873176368849408:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1786400510.993729:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390224c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:11450:x1873176368849408:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 287us (477us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1786400510.993771:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1786400511.061581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.061687:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368849664 00000100:00100000:0.0:1786400511.061698:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368849664 00000100:00100000:0.0:1786400511.061788:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 160 00000100:00100000:0.0:1786400511.061799:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:11456:x1873176368849664:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400511.061824:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400511.061855:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a5c23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5312 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.061955:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.061969:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 48 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.062008:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.062044:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 48 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.062057:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 48 pid: 8098 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400511.062071:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392971136:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400511.062160:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86240 going to sleep for 11 seconds 00000100:00080000:2.0:1786400511.062628:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400511.066683:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392971136:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400511.066723:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400511.068196:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.068304:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368849792 00000100:00100000:0.0:1786400511.068313:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368849792 00010000:00010000:0.0:1786400511.068352:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 49 pid: 8098 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400511.068402:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:0.0:1786400511.068412:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+49:2361:x1873176368849792:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400511.068427:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400511.068434:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 49 pid: 8098 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.068470:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 49 pid: 8098 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.068493:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5304 expref: 49 pid: 8098 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.068510:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:0.0:1786400511.068515:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.068525:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.068532:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.068563:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400511.068624:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+48:2361:x1873176368849792:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 213us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400511.068632:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 66 00010000:00010000:1.0:1786400511.069498:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.069510:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400511.069529:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1786400511.069693:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a5c23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 49 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.069709:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 48 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.069972:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:1.0:1786400511.069975:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786400511.069978:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49200, rc 0) 00000100:00100000:1.0:1786400511.070034:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+48:11456:x1873176368849664:12345-192.168.201.23@tcp:101:bash.0 Request processed in 8237us (8461us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1786400511.070051:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 160 00000100:00100000:1.0:1786400511.075982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.076058:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368850048 00000100:00100000:0.0:1786400511.076069:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368850048 00000100:00100000:0.0:1786400511.076131:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 161 00000100:00100000:0.0:1786400511.076141:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+48:11456:x1873176368850048:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:0.0:1786400511.076560:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.076578:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.076605:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786400511.076658:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1786400511.076683:0:5818:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e57fd095 reply state 0000000009a1707a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400511.076692:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786400511.076816:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:11456:x1873176368850048:12345-192.168.201.23@tcp:36:bash.0 Request processed in 675us (840us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1786400511.076824:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 161 00000020:00080000:0.0:1786400511.076829:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786400511.078918:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.078937:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.078944:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.078950:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400511.078954:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.078963:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.078979:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:2.0:1786400511.078983:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400511.078988:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.078994:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49400/0x49554f35ff0a5c38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400511.083938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400511.084327:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368850176 00000100:00100000:3.0:1786400511.084339:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368850176 00000100:00100000:3.0:1786400511.084412:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 162 00000100:00100000:3.0:1786400511.084423:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:11456:x1873176368850176:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1786400511.084450:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400511.084475:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5c3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5319 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.084586:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.084600:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.084609:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.084653:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.084666:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 51 pid: 5817 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400511.084679:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373afe43100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392971264:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400511.084790:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400511.088578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400511.088775:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368850304 00000100:00100000:1.0:1786400511.088785:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368850304 00010000:00010000:1.0:1786400511.088828:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 52 pid: 5817 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400511.088877:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:1.0:1786400511.088888:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:2361:x1873176368850304:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400511.088903:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400511.088910:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 52 pid: 5817 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.088924:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 52 pid: 5817 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.088948:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:1.0:1786400511.088953:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.088963:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.088971:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.088989:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400511.089067:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:2361:x1873176368850304:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 180us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400511.089075:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 67 00010000:00010000:0.0:1786400511.089505:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5312 expref: 51 pid: 5817 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400511.089523:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373afe43100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392971264:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400511.089545:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.089554:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.089560:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400511.089604:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1786400511.089608:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400511.089629:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.089669:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5c3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5319 expref: 51 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.089684:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5319 expref: 50 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.089691:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:0.0:1786400511.089694:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400511.089697:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:0.0:1786400511.089782:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:11456:x1873176368850176:12345-192.168.201.23@tcp:101:bash.0 Request processed in 5316us (5810us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400511.089792:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 162 00000100:00100000:3.0:1786400511.093916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.094025:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368850560 00000100:00100000:0.0:1786400511.094035:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368850560 00000100:00100000:0.0:1786400511.094093:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:0.0:1786400511.094103:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:11456:x1873176368850560:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:0.0:1786400511.094383:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:11456:x1873176368850560:12345-192.168.201.23@tcp:35:bash.0 Request processed in 281us (477us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1786400511.094399:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00010000:00010000:2.0:1786400511.123086:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400511.207460:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.207585:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368850816 00000100:00100000:0.0:1786400511.207595:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368850816 00000100:00100000:0.0:1786400511.207672:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 163 00000100:00100000:0.0:1786400511.207683:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:11466:x1873176368850816:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400511.207719:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400511.207770:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5320 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400511.208016:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1786400511.208147:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c4d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5320 expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.208161:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:0.0:1786400511.208164:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400511.208169:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5320 expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.208183:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49200, rc 0) 00000100:00100000:0.0:1786400511.208259:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:11466:x1873176368850816:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 577us (809us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1786400511.208267:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 163 00000100:00100000:2.0:1786400511.212854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400511.212985:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368850944 00000100:00100000:1.0:1786400511.212997:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368850944 00000100:00100000:1.0:1786400511.213055:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 164 00000100:00100000:1.0:1786400511.213066:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:11466:x1873176368850944:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:1.0:1786400511.213147:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213165:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213177:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213192:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213213:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213221:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213330:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213338:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213346:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400511.213410:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213423:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213430:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213436:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213442:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400511.213447:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213454:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213465:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:1.0:1786400511.213468:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400511.213473:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213478:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5c5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213491:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213497:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213508:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213513:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400511.213516:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213523:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213531:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373850bfa00) 00010000:00010000:1.0:1786400511.213533:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400511.213536:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213542:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5c62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213557:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213563:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213569:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213574:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400511.213576:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213594:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213601:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:1.0:1786400511.213603:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400511.213606:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400511.213611:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a5c69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400511.213683:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:11466:x1873176368850944:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 618us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400511.213692:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 164 00000100:00100000:3.0:1786400511.217563:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.217660:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368851200 00000100:00100000:0.0:1786400511.217670:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368851200 00000100:00100000:0.0:1786400511.217734:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:0.0:1786400511.217777:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:11466:x1873176368851200:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1786400511.218053:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:11466:x1873176368851200:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 278us (500us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1786400511.218062:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:2.0:1786400511.265607:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.265777:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368851456 00000100:00100000:0.0:1786400511.265789:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368851456 00000100:00100000:0.0:1786400511.265849:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 165 00000100:00100000:0.0:1786400511.265860:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+53:11469:x1873176368851456:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400511.265885:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400511.265913:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5327 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266028:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266042:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266056:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266072:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266079:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266084:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266231:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266240:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266247:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400511.266256:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1786400511.266355:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266374:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266380:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266385:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400511.266390:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266397:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266409:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400511.266413:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400511.266418:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266423:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5c77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266436:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266443:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266449:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266454:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400511.266464:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266470:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266479:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93739128d800) 00010000:00010000:0.0:1786400511.266482:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400511.266485:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266491:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5c7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266538:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5c70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5327 expref: 56 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266552:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5327 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.266559:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:0.0:1786400511.266561:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400511.266564:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48000, rc 0) 00000100:00100000:0.0:1786400511.266637:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:11469:x1873176368851456:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 778us (1039us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1786400511.266644:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 165 00000100:00100000:2.0:1786400511.271211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400511.271309:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368851584 00000100:00100000:3.0:1786400511.271319:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368851584 00000100:00100000:3.0:1786400511.271401:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:3.0:1786400511.271413:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:2362:x1873176368851584:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400511.271433:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400511.271459:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5327 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.271477:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400511.271481:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400511.271545:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:2362:x1873176368851584:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 134us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400511.271552:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:3.0:1786400511.273570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.273721:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368851712 00000100:00100000:0.0:1786400511.273730:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368851712 00000100:00100000:0.0:1786400511.273821:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 166 00000100:00100000:0.0:1786400511.273831:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:11469:x1873176368851712:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:0.0:1786400511.273920:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.273936:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.273958:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.273985:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.273992:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.273998:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.274004:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400511.274008:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.274024:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.274037:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:0.0:1786400511.274040:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400511.274044:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.274050:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400511.274120:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:11469:x1873176368851712:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 291us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400511.274127:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 166 00000100:00100000:2.0:1786400511.277177:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.277424:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368851968 00000100:00100000:0.0:1786400511.277435:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368851968 00000100:00100000:0.0:1786400511.277502:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:0.0:1786400511.277512:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:11469:x1873176368851968:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1786400511.281763:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:11469:x1873176368851968:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 4228us (4571us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1786400511.281778:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:2.0:1786400511.443347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400511.443436:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368852224 00000100:00100000:3.0:1786400511.443468:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368852224 00000100:00100000:3.0:1786400511.443528:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 167 00000100:00100000:3.0:1786400511.443539:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:11488:x1873176368852224:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:3.0:1786400511.443565:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400511.443587:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f532e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.443721:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ca1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.443755:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.443767:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400511.443778:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1786400511.444348:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f532e expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.444370:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f532e expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.444380:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400511.444383:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1786400511.444388:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031600, rc 0) 00000100:00100000:3.0:1786400511.444464:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11488:x1873176368852224:12345-192.168.201.23@tcp:101:cat.0 Request processed in 926us (1126us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1786400511.444472:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 167 00000100:00100000:3.0:1786400511.470927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.471001:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368852352 00000100:00100000:0.0:1786400511.471012:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368852352 00000100:00100000:0.0:1786400511.471078:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 168 00000100:00100000:0.0:1786400511.471089:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11489:x1873176368852352:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400511.471120:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400511.471144:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5caf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5335 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.471225:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5cb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.471239:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.471250:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400511.471342:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1786400511.471346:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400511.471368:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.471396:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5caf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5335 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.471416:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5335 expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.471425:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400511.471428:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400511.471432:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49200, rc 0) 00000100:00100000:0.0:1786400511.471510:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11489:x1873176368852352:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 422us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400511.471518:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 168 00000100:00100000:2.0:1786400511.474905:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400511.474993:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368852736 00000100:00100000:3.0:1786400511.475003:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368852736 00000100:00100000:3.0:1786400511.475069:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:3.0:1786400511.475080:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11489:x1873176368852736:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400511.475478:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11489:x1873176368852736:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 400us (583us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1786400511.475486:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:2.0:1786400511.478029:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400511.478347:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368852864 00000100:00100000:3.0:1786400511.478358:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368852864 00000100:00100000:3.0:1786400511.478427:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:3.0:1786400511.478436:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9112680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11489:x1873176368852864:12345-192.168.201.23@tcp:103:lfs.0 00010000:00010000:3.0:1786400511.478452:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1786400511.478476:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5319 expref: 59 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.478497:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ca1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f532e expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.478507:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52da expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400511.478517:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801600) 00010000:00010000:3.0:1786400511.478528:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400511.478585:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9112680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:11489:x1873176368852864:12345-192.168.201.23@tcp:103:lfs.0 Request processed in 149us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400511.478592:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:3.0:1786400511.480638:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400511.480690:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368852992 00000100:00100000:0.0:1786400511.480699:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368852992 00000100:00100000:0.0:1786400511.480950:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 169 00000100:00100000:0.0:1786400511.480961:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:11489:x1873176368852992:12345-192.168.201.23@tcp:58:lfs.0 00010000:00010000:0.0:1786400511.481076:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.481093:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.481105:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786400511.481303:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1786400511.481404:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:11489:x1873176368852992:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 444us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400511.481412:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 169 00000001:00080000:0.0:1786400511.493983:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1786400511.494010:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1786400511.519499:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400511.519645:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368853120 00000100:00100000:3.0:1786400511.519659:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368853120 00000100:00100000:0.0:1786400511.519890:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 170 00000100:00100000:0.0:1786400511.519903:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:11491:x1873176368853120:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400511.519924:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400511.519946:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5cc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f533c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.520010:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.520027:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400511.520039:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520227:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520236:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520244:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520341:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520350:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520358:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400511.520458:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1786400511.520463:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400511.520484:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520497:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520507:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520527:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520601:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520607:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400511.520669:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520676:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520688:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400511.520691:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400511.520695:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520702:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5ccb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520983:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520991:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.520997:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.521002:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400511.521013:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.521019:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.521027:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff937386801100) 00010000:00010000:2.0:1786400511.521029:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400511.521033:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.521038:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.521075:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5cc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.521088:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400511.521094:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:2.0:1786400511.521096:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786400511.521098:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fc00, rc 0) 00000100:00100000:2.0:1786400511.521169:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11491:x1873176368853120:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1269us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400511.521177:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 170 00000040:00080000:0.0:1786400512.146989:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400512.147000:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400512.147058:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1786400512.147066:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400512.147207:0:11579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392971392:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786400512.147512:0:11579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490180 going to sleep for 11 seconds 00010000:00010000:0.0:1786400512.148278:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400512.152115:0:11579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392971392:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786400512.155828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400512.158838:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368853248 00000100:00100000:2.0:1786400512.158862:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368853248 00000100:00100000:2.0:1786400512.159208:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 171 00000100:00100000:2.0:1786400512.159220:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11502:x1873176368853248:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786400512.159285:0:5816:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786400512.159423:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11502:x1873176368853248:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 205us (3606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400512.159431:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 171 00000100:00100000:2.0:1786400512.162138:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.162238:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368853376 00000100:00100000:3.0:1786400512.162263:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368853376 00000100:00100000:3.0:1786400512.162320:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 172 00000100:00100000:3.0:1786400512.162329:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11502:x1873176368853376:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.162410:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162430:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162442:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162457:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162464:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162471:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162496:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162504:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162510:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400512.162553:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1786400512.162558:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400512.162570:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162581:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162587:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162594:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162600:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400512.162604:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162612:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162625:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:3.0:1786400512.162628:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400512.162632:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162638:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5ce0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162652:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162669:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162692:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162697:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400512.162700:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162705:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162713:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9373a3445100) 00010000:00010000:3.0:1786400512.162716:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400512.162719:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162725:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5ce7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162790:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162797:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162802:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162806:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400512.162814:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162820:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162827:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:3.0:1786400512.162830:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400512.162832:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.162837:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5cee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.162927:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11502:x1873176368853376:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 598us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400512.162935:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 172 00000100:00100000:3.0:1786400512.168150:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400512.174364:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368853632 00000100:00100000:0.0:1786400512.174444:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368853632 00000100:00100000:1.0:1786400512.178069:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 173 00000100:00100000:1.0:1786400512.178086:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11502:x1873176368853632:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400512.178109:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400512.178130:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5cf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5343 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178243:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178268:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178280:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400512.178304:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1786400512.178416:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178425:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178431:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178437:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebea00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400512.178442:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178450:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178462:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:1.0:1786400512.178465:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400512.178470:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178476:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5cfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178515:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5cf5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5343 expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178524:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:1.0:1786400512.178526:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400512.178537:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5cf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5343 expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.178546:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf600, rc 0) 00000100:00100000:1.0:1786400512.178667:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11502:x1873176368853632:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 585us (10526us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1786400512.178685:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 173 00000100:00100000:0.0:1786400512.184815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400512.184962:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368853760 00000100:00100000:2.0:1786400512.184973:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368853760 00000100:00100000:2.0:1786400512.185035:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 174 00000100:00100000:2.0:1786400512.185047:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11502:x1873176368853760:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786400512.185087:0:8098:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786400512.185203:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11502:x1873176368853760:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 158us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400512.185211:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 174 00000100:00100000:0.0:1786400512.200025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.200172:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368854016 00000100:00100000:3.0:1786400512.200191:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368854016 00000100:00100000:3.0:1786400512.200249:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 175 00000100:00100000:3.0:1786400512.200259:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11502:x1873176368854016:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.200280:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400512.200283:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786400512.200310:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5cb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5335 expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.200328:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:3.0:1786400512.200332:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400512.200355:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5d0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f534a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786400512.200798:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1786400512.201068:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.201082:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.201092:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.201146:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5d0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f534a expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.201161:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f534a expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.201169:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373a3445100) 00010000:00010000:3.0:1786400512.201171:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400512.201174:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:3.0:1786400512.201246:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11502:x1873176368854016:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 989us (1231us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1786400512.201255:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 175 00000100:00100000:3.0:1786400512.206464:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.206504:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368854272 00000100:00100000:3.0:1786400512.206514:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368854272 00000100:00100000:3.0:1786400512.206568:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 176 00000100:00100000:3.0:1786400512.206578:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11502:x1873176368854272:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.206654:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400512.206682:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f534a expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206702:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373a3445100) 00010000:00010000:3.0:1786400512.206713:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400512.206735:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206767:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206777:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206792:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206799:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206805:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206883:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206890:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206896:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206908:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400512.206912:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206920:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206928:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:3.0:1786400512.206931:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400512.206934:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206940:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5d1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206949:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206954:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206958:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206962:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400512.206965:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206970:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206988:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6fbf717c (ffff9373a3445400) 00010000:00010000:3.0:1786400512.206991:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400512.206993:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.206999:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6fbf717c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.207080:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11502:x1873176368854272:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 502us (625us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786400512.207088:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 176 00000100:00100000:1.0:1786400512.212803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400512.212835:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368854400 00000100:00100000:1.0:1786400512.212844:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368854400 00000100:00100000:1.0:1786400512.213326:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 177 00000100:00100000:1.0:1786400512.213338:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11502:x1873176368854400:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400512.213360:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400512.213533:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5d2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5351 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.213570:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.213583:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.213595:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.214049:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.214068:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.214085:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:1.0:1786400512.214089:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786400512.214093:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebfc00, rc 0) 00000100:00100000:1.0:1786400512.214160:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11502:x1873176368854400:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 823us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400512.214168:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 177 00000100:00100000:0.0:1786400512.219290:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.219380:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368854656 00000100:00100000:3.0:1786400512.219391:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368854656 00000100:00100000:3.0:1786400512.219492:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 178 00000100:00100000:3.0:1786400512.219503:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11502:x1873176368854656:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.219593:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.219611:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.219624:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786400512.219964:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1786400512.219974:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 433961234806ns, next at 434961232101ns, rc = 0 00000004:00010000:3.0:1786400512.220064:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffb7fb55 reply state 00000000d5d22538 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.220086:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786400512.220180:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11502:x1873176368854656:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 678us (953us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1786400512.220200:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 178 00010000:00010000:0.0:1786400512.221995:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.222012:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.222020:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.222027:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400512.222031:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.222039:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.222056:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:0.0:1786400512.222059:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786400512.222064:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.222070:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.222681:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.226019:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368854784 00000100:00100000:3.0:1786400512.226034:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368854784 00000100:00100000:3.0:1786400512.226104:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 179 00000100:00100000:3.0:1786400512.226115:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11502:x1873176368854784:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.226140:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400512.226165:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.226237:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.226251:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.226271:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:3.0:1786400512.226274:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786400512.226278:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763800, rc 0) 00000100:00100000:3.0:1786400512.226345:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11502:x1873176368854784:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 232us (3668us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400512.226354:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 179 00000100:00100000:3.0:1786400512.229073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400512.229157:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368854912 00000100:00100000:0.0:1786400512.229167:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368854912 00000100:00100000:0.0:1786400512.229252:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:0.0:1786400512.229263:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368854912:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1786400512.229574:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368854912:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 312us (508us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1786400512.229583:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00080000:1.0:1786400512.229929:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400512.243702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400512.245381:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368855168 00000100:00100000:0.0:1786400512.245397:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368855168 00000100:00100000:0.0:1786400512.245509:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1786400512.245523:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11502:x1873176368855168:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786400512.245817:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:11502:x1873176368855168:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 297us (2122us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1786400512.245826:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1786400512.253452:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400512.253501:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368855424 00000100:00100000:0.0:1786400512.253512:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368855424 00000100:00100000:0.0:1786400512.253583:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 180 00000100:00100000:0.0:1786400512.253595:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:11502:x1873176368855424:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786400512.253956:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:11502:x1873176368855424:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 362us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400512.253964:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 180 00000100:00100000:0.0:1786400512.264569:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400512.264622:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368855552 00000100:00100000:0.0:1786400512.264631:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368855552 00000100:00100000:0.0:1786400512.264695:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 181 00000100:00100000:0.0:1786400512.264706:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:11502:x1873176368855552:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400512.264731:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400512.264774:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49800/0x49554f35ff0a5d49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f535f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.264862:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.264880:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.264894:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400512.264936:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400512.264956:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.264985:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49800/0x49554f35ff0a5d49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f535f expref: 64 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.265004:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f535f expref: 63 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.265013:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:0.0:1786400512.265016:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786400512.265020:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49e00, rc 0) 00000100:00100000:0.0:1786400512.265086:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+63:11502:x1873176368855552:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 380us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400512.265094:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 181 00000100:00100000:3.0:1786400512.275087:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400512.275207:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368855680 00000100:00100000:1.0:1786400512.275218:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368855680 00000100:00100000:1.0:1786400512.275283:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:1.0:1786400512.275294:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368855680:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400512.275315:0:11904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400512.275336:0:11904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5366 expref: -99 pid: 11904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400512.275365:0:11904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a4f00, blocks: 0x1 00010000:00010000:1.0:1786400512.275398:0:11904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1786400512.275403:0:11904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400512.275413:0:11904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 8 pid: 11904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.275433:0:11904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 8 pid: 11904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.275448:0:11904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebea00, rc 0) 00000100:00100000:1.0:1786400512.275526:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368855680:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 234us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400512.275534:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:0.0:1786400512.292582:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.293886:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368855936 00000100:00100000:3.0:1786400512.293900:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368855936 00000100:00100000:3.0:1786400512.293962:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 182 00000100:00100000:3.0:1786400512.293972:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+63:11502:x1873176368855936:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786400512.294081:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+63:11502:x1873176368855936:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 110us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400512.294088:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 182 00000100:00100000:3.0:1786400512.317625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.317661:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368856064 00000100:00100000:3.0:1786400512.317670:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368856064 00000100:00100000:3.0:1786400512.317713:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:3.0:1786400512.317722:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:11502:x1873176368856064:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.317759:0:10836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400512.317777:0:10836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f536d expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.317809:0:10836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 9 pid: 11904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.317819:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400512.317823:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400512.317828:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 9 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.317859:0:10836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 9 pid: 11904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.317884:0:10836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 9 pid: 11904 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.317898:0:10836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10836:1873176392971520:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400512.317975:0:10836:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc6600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400512.329119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400512.329233:0:10836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10836:1873176392971520:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400512.329275:0:10836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 9 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.329294:0:10836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762600, rc 0) 00000100:00100000:2.0:1786400512.329346:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:11502:x1873176368856064:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 11625us (11730us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400512.329355:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:0.0:1786400512.332430:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368856192 00000100:00100000:0.0:1786400512.332443:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368856192 00010000:00010000:0.0:1786400512.332485:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 9 pid: 11904 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.332596:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:0.0:1786400512.332608:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2361:x1873176368856192:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400512.332623:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400512.332647:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 9 pid: 11904 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.332664:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 9 pid: 11904 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.332688:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078781a0b/0x49554f35ff0a5d57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5366 expref: 9 pid: 11904 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.332701:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400512.332706:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400512.332714:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 8 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.332735:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 8 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.332792:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 8 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.332807:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1873176392971648:192.168.201.23@tcp:105: 00000100:00100000:0.0:1786400512.332889:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490180 going to sleep for 11 seconds 00000100:00100000:0.0:1786400512.341360:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1873176392971648:192.168.201.23@tcp:105: 00010000:00010000:0.0:1786400512.341388:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400512.341436:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368856192:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 8830us (12324us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400512.341447:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:1.0:1786400512.342599:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400512.342678:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368856320 00000100:00100000:1.0:1786400512.342686:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368856320 00002000:00100000:1.0:1786400512.342730:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9373b8f47800 x1873176368856320/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:308/0 lens 504/0 e 0 to 0 dl 1786400523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400512.342767:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b8f47800 with x1873176368856320 ext(0->8) 00002000:00010000:1.0:1786400512.342773:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b8f47800 00000100:00100000:1.0:1786400512.342794:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:1.0:1786400512.342804:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368856320:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1786400512.343226:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2362:x1873176368856320:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 Request processed in 423us (631us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1786400512.343234:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00002000:00100000:1.0:1786400512.343241:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9373b8f47800 x1873176368856320/t4294967315(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:308/0 lens 504/448 e 0 to 0 dl 1786400523 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400512.343249:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b8f47800 with x1873176368856320 ext(0->8) 00002000:00010000:1.0:1786400512.343253:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b8f47800 00000040:00080000:0.0:1786400512.359068:0:12347:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400512.359079:0:12347:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400512.359121:0:12347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1786400512.359128:0:12347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400512.359588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.359799:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368856448 00000100:00100000:3.0:1786400512.359811:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368856448 00000100:00100000:3.0:1786400512.359866:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 183 00000100:00100000:3.0:1786400512.359877:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+63:11502:x1873176368856448:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1786400512.448482:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+63:11502:x1873176368856448:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 88595us (88887us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400512.448495:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 183 00000001:00080000:1.0:1786400512.448576:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1786400512.448660:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1786400512.448708:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1786400512.448725:0:5839:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9373b0730600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1786400512.448730:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373bf7fe500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93738d7bd780 00000020:00080000:1.0:1786400512.448760:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373bf7fef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff937388c7bc00 00000100:00100000:0.0:1786400512.448857:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392971776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786400512.454829:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400512.455036:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400512.455050:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392971904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786400512.455114:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400512.456420:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392971776 00000100:00100000:1.0:1786400512.456432:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392971776 00000100:00100000:1.0:1786400512.456494:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392971904 00000100:00100000:1.0:1786400512.456497:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392971904 00000100:00100000:1.0:1786400512.456519:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786400512.456527:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392971776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786400512.456699:0:6623:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1786400512.456703:0:6623:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786400512 00002000:00010000:1.0:1786400512.456705:0:6623:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786400512.456708:0:6623:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1786400512 -> 1786400512 00002000:00010000:1.0:1786400512.456710:0:6623:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786400512.456791:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392971776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 264us (1971us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1786400512.456798:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786400512.456815:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786400512.456821:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392971904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786400512.456834:0:6623:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1786400512.456856:0:6623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a7a4efd, atime: 0x6a7a4efd, ctime: 0x6a7a4efd, blocks: 0xb 00010000:00010000:1.0:1786400512.456864:0:6623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.456878:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1786400512.456883:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400512.456888:0:6623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.456919:0:6623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.456929:0:6623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.456937:0:6623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.456953:0:6623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1786400512.457382:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1786400512.457547:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1786400512.457607:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400512.457615:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.457635:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfa00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400512.457640:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.457650:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.457667:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.457675:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000466fbf9a/0x49554f35ff0a5d65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.457705:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400512.457706:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400512.457708:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786400512.458811:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400512.458818:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400512.461806:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392971904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4977us (6683us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1786400512.461820:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1786400512.461890:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff937282435180/2, rc 0, transno 4294967316 00000100:00100000:1.0:1786400512.461897:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392971776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786400512.463934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400512.464196:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368856576 00000100:00100000:1.0:1786400512.464205:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368856576 00000100:00100000:1.0:1786400512.464264:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:1.0:1786400512.464274:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2362:x1873176368856576:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1786400512.468521:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1786400512.468534:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1786400512.468570:0:3318:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff937388c91c00 x1873176392971904/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786400528 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786400512.468585:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff937388c91c00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1786400512.468591:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392971904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786400512.538611:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2362:x1873176368856576:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 74327us (74674us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400512.538638:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00000001:00080000:1.0:1786400512.538685:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1786400512.538696:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1786400512.538709:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1786400512.542902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.542985:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368856832 00000100:00100000:3.0:1786400512.543052:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368856832 00000100:00100000:3.0:1786400512.543109:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 184 00000100:00100000:3.0:1786400512.543119:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:11502:x1873176368856832:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.543187:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400512.543220:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f535f expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.543240:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:3.0:1786400512.543246:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400512.543280:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.543294:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.543317:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786400512.543581:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0be43d5 reply state 00000000c3b0866a transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.543591:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786400512.543704:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373a0c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:11502:x1873176368856832:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 586us (812us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1786400512.543712:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 184 00000100:00100000:1.0:1786400512.547629:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400512.547798:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368856960 00000100:00100000:0.0:1786400512.547810:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368856960 00000100:00100000:0.0:1786400512.547866:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:0.0:1786400512.547876:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368856960:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.548167:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.548191:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.548199:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.548205:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400512.548210:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.548217:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786400512.548220:0:6622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1786400512.548223:0:6622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1786400512 -> 1786400510 00002000:00010000:0.0:1786400512.548226:0:6622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786400509 00002000:00010000:0.0:1786400512.548228:0:6622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1786400512 -> 1786400510 00002000:00010000:0.0:1786400512.548229:0:6622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1786400512.548244:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:3.0:1786400512.548248:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400512.548253:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.548270:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5d6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.548288:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368856960:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 413us (670us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1786400512.548296:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:0.0:1786400512.550845:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400512.550923:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368857216 00000100:00100000:1.0:1786400512.550933:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368857216 00000100:00100000:1.0:1786400512.551073:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 185 00000100:00100000:1.0:1786400512.551084:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:11502:x1873176368857216:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786400512.551161:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.551189:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.551200:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.551235:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.551248:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 18 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400512.551263:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392972032:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400512.551361:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390910180 going to sleep for 11 seconds 00000100:00100000:3.0:1786400512.554877:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392972032:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400512.554908:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.559342:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.559633:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368857344 00000100:00100000:3.0:1786400512.559643:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368857344 00010000:00010000:3.0:1786400512.559698:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 19 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.559750:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:3.0:1786400512.559760:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:2361:x1873176368857344:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400512.559773:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400512.559779:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 19 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.559792:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 19 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.559814:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5d34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5351 expref: 19 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.559827:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:3.0:1786400512.559832:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.560023:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.560031:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.560067:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400512.560123:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:2361:x1873176368857344:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 363us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400512.560131:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00010000:00010000:2.0:1786400512.561830:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.561846:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.561878:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.561886:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.561904:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.561909:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebee00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400512.561913:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.561921:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.561934:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:2.0:1786400512.561937:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786400512.561941:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.561948:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5d73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400512.562103:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:11502:x1873176368857216:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 Request processed in 11017us (11268us total) trans 0 rc -22/-22 00000100:00100000:2.0:1786400512.562114:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 185 00000100:00100000:3.0:1786400512.575306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.575343:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368857472 00000100:00100000:3.0:1786400512.575353:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368857472 00000100:00100000:3.0:1786400512.575402:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:3.0:1786400512.575412:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368857472:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786400512.575457:0:6623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.575478:0:6623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 8 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.575487:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400512.575491:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400512.575495:0:6623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.575527:0:6623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 8 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.575548:0:6623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 8 pid: 10836 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.575564:0:6623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6623:1873176392972160:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400512.575643:0:6623:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373840b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1786400512.596793:0:6623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6623:1873176392972160:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400512.596831:0:6623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.600420:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400512.601391:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368857600 00000100:00100000:0.0:1786400512.601404:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368857600 00010000:00010000:0.0:1786400512.601448:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 9 pid: 10836 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.601507:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:0.0:1786400512.601516:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2362:x1873176368857600:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400512.601533:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400512.601555:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 9 pid: 10836 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.601569:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 9 pid: 10836 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.601593:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4e6437b/0x49554f35ff0a5d5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f536d expref: 9 pid: 10836 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.601608:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400512.601613:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400512.601619:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.601629:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.602184:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400512.602260:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368857600:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 742us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400512.602270:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 70 00010000:00010000:2.0:1786400512.605787:0:6623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.605823:0:6623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.605859:0:6623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.605869:0:6623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.605877:0:6623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.605885:0:6623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400512.605890:0:6623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.605900:0:6623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.605921:0:6623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.605929:0:6623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000517cacc5/0x49554f35ff0a5d7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400512.606781:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368857472:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 31359us (31474us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400512.606795:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:3.0:1786400512.616971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400512.618078:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368857856 00000100:00100000:0.0:1786400512.618091:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368857856 00000100:00100000:0.0:1786400512.618147:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 186 00000100:00100000:0.0:1786400512.618157:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+17:11502:x1873176368857856:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786400512.618260:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.618277:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.618288:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.618498:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.618510:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.618517:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.618553:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.618566:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 18 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.618580:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7761180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392972288:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400512.618682:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400512.626488:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7761180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392972288:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400512.626520:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.626613:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400512.626826:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368857984 00000100:00100000:3.0:1786400512.626834:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368857984 00010000:00010000:3.0:1786400512.626870:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 19 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.626911:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:3.0:1786400512.626922:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:2362:x1873176368857984:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400512.626938:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400512.626944:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 19 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.626957:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 19 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.626998:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5358 expref: 19 pid: 5816 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.627012:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:3.0:1786400512.627017:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.627027:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.627035:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400512.627074:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400512.627095:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.627102:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400512.627131:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+18:2362:x1873176368857984:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 210us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400512.627138:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 71 00000001:00080000:0.0:1786400512.627319:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1786400512.627472:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1786400512.627515:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1786400512.627592:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7761500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392972416:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400512.637831:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400512.637881:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490000 going to sleep for 11 seconds 00000100:00100000:3.0:1786400512.639341:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392972416 00000100:00100000:3.0:1786400512.639353:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392972416 00000100:00100000:3.0:1786400512.639426:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786400512.639437:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5817:x1873176392972416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786400512.639557:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5817:x1873176392972416:12345-0@lo:1000:mdt00_001.0 Request processed in 122us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400512.639565:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786400512.640354:0:5817:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1786400512.640363:0:5817:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff937282435180, transno 4294967316 00000100:00100000:0.0:1786400512.640429:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7761500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392972416:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786400512.642114:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1786400512.642213:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7761500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392972544:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400512.642346:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400512.642524:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0490300 going to sleep for 11 seconds 00000100:00100000:1.0:1786400512.644869:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392972544 00000100:00100000:1.0:1786400512.644882:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392972544 00000100:00100000:0.0:1786400512.645833:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400512.645845:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5817:x1873176392972544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400512.646148:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5817:x1873176392972544:12345-0@lo:1000:mdt00_001.0 Request processed in 304us (3801us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1786400512.646157:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400512.646223:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7761500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5817:1873176392972544:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786400512.646269:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646292:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646299:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646305:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400512.646309:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646317:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646332:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9373850bfa00) 00010000:00010000:0.0:1786400512.646334:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400512.646337:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646342:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5d88 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646371:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646377:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646382:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646386:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400512.646394:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646399:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646407:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:0.0:1786400512.646409:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400512.646411:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646416:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5cbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646435:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646447:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646455:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646483:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.646497:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 21 pid: 5817 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400512.646511:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7762680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392972672:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400512.646585:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390825e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400512.653636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400512.653779:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7762680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392972672:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400512.653811:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400512.654107:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368858112 00000100:00100000:1.0:1786400512.654114:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368858112 00010000:00010000:1.0:1786400512.654148:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 22 pid: 5817 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400512.654231:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 72 00000100:00100000:1.0:1786400512.654242:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:2361:x1873176368858112:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400512.654256:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400512.654262:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 22 pid: 5817 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.654274:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 22 pid: 5817 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.654295:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5cd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f533c expref: 22 pid: 5817 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.654309:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:1.0:1786400512.654314:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.654323:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.654330:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400512.654354:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400512.654404:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:2361:x1873176368858112:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 164us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400512.654411:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 72 00010000:00010000:2.0:1786400512.654455:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654463:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654477:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654483:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654490:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654497:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49a00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400512.654501:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654508:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654527:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:2.0:1786400512.654529:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400512.654533:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654539:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5d8f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654549:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654554:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654560:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654565:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400512.654568:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654573:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654579:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d800) 00010000:00010000:2.0:1786400512.654581:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400512.654583:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.654588:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5d81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400512.654798:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:11502:x1873176368857856:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 36643us (37837us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1786400512.654807:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 186 00000020:00080000:2.0:1786400512.654810:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1786400512.655090:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400512.655095:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400512.655628:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1786400512.655636:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400512.659644:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400512.660024:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368858368 00000100:00100000:2.0:1786400512.660034:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368858368 00000100:00100000:2.0:1786400512.660158:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:2.0:1786400512.660169:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390227050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:11502:x1873176368858368:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786400512.661424:0:5819:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786400512.661538:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1786400512.661592:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.661607:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.661689:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.661700:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.661706:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.661712:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400512.661868:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786400512.661991:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390227050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:11502:x1873176368858368:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1821us (2352us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1786400512.662001:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000020:00080000:2.0:1786400512.662006:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786400512.662512:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400512.662520:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.662528:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ee00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400512.662533:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.662542:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.662555:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff937386801900) 00010000:00010000:0.0:1786400512.662558:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786400512.662562:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.662566:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a5d96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400512.662585:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400512.662587:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400512.662588:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400513.171103:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400513.943298:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392972800:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.943375:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400513.943426:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392973312:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.943482:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400513.943517:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400513.943524:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392973184:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.943548:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400513.943573:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392972928:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.943595:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400513.943611:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392973440:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.943631:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400513.943647:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400513.943652:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392973056:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.943673:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400513.943701:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392973312 00000100:00100000:0.0:1786400513.943707:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392973312 00000100:00100000:0.0:1786400513.943779:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392972928 00000100:00100000:0.0:1786400513.943782:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392972928 00000100:00100000:0.0:1786400513.943796:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392973056 00000100:00100000:0.0:1786400513.943799:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392973056 00000100:00100000:0.0:1786400513.943818:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1786400513.943825:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392973312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944066:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392973312:12345-0@lo:400:kworker.0 Request processed in 239us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400513.944075:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1786400513.944094:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1786400513.944100:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392972928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944137:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392972928:12345-0@lo:400:kworker.0 Request processed in 37us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400513.944143:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1786400513.944176:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1786400513.944183:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392973056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944215:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392973056:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400513.944221:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1786400513.944240:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392973184 00000100:00100000:0.0:1786400513.944244:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392973184 00000100:00100000:0.0:1786400513.944269:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392973440 00000100:00100000:0.0:1786400513.944272:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392973440 00000100:00100000:0.0:1786400513.944290:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1786400513.944296:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392973184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944324:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1873176392973184:12345-0@lo:400:kworker.0 Request processed in 28us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400513.944330:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1786400513.944341:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786400513.944347:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392973440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944372:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392973440:12345-0@lo:400:kworker.0 Request processed in 25us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400513.944377:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1786400513.944403:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400513.944437:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392973184:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944449:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392973312:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944478:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392973056:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944701:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392972928:0@lo:400:kworker.0 00000100:00100000:0.0:1786400513.944714:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392973440:0@lo:400:kworker.0 00000100:00100000:3.0:1786400513.944818:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392972800 00000100:00100000:3.0:1786400513.944823:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392972800 00000100:00100000:3.0:1786400513.944857:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1786400513.944864:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392972800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400513.944925:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392972800:12345-0@lo:400:kworker.0 Request processed in 61us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400513.944932:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1786400513.945069:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392972800:0@lo:400:kworker.0 00010000:00010000:0.0:1786400514.194972:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786400514.391003:0:12399:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400514.391014:0:12399:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400514.391049:0:12399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1786400514.391054:0:12399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400514.450983:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400514.451011:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b798a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392973568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400514.451088:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400514.451587:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392973568 00000100:00100000:2.0:1786400514.451596:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392973568 00000100:00100000:2.0:1786400514.451666:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1786400514.451677:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392973568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400514.451717:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400514.451799:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392973568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400514.451807:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1786400514.451856:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b798a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392973568:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786400514.451931:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400514.520914:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400514.520973:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368858624 00000100:00100000:3.0:1786400514.520986:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368858624 00000100:00100000:3.0:1786400514.521069:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 187 00000100:00100000:3.0:1786400514.521080:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:11520:x1873176368858624:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400514.521105:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400514.521127:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5374 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.521428:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5da4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.521443:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5da4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.521456:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5da4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400514.521469:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1786400514.521640:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5374 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.521669:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5da4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5374 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.521677:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:3.0:1786400514.521684:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786400514.521688:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031600, rc 0) 00000100:00100000:3.0:1786400514.521770:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11520:x1873176368858624:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 692us (867us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1786400514.521777:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 187 00000100:00080000:0.0:1786400514.521942:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400514.525630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.525787:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368858752 00000100:00100000:0.0:1786400514.525799:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368858752 00000100:00100000:0.0:1786400514.525870:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 188 00000100:00100000:0.0:1786400514.525881:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11520:x1873176368858752:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:0.0:1786400514.525961:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.525979:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.525991:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526004:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526010:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526015:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526521:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526536:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526544:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400514.526585:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526599:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526606:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526613:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526618:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.526622:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526629:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526641:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400514.526644:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.526884:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526894:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526913:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526919:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526925:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526930:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.526934:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526939:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526947:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93739128d200) 00010000:00010000:0.0:1786400514.526950:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.526953:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526959:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526974:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526979:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526985:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.526997:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.527000:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.527005:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.527013:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93739128d300) 00010000:00010000:0.0:1786400514.527015:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.527018:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.527022:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5dc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400514.527155:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11520:x1873176368858752:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 1265us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400514.527164:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 188 00000100:00100000:3.0:1786400514.601195:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400514.601245:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368859008 00000100:00100000:3.0:1786400514.601256:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368859008 00000100:00100000:3.0:1786400514.601307:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 189 00000100:00100000:3.0:1786400514.601316:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11523:x1873176368859008:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400514.601339:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400514.601360:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5dc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f537b expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601430:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601445:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601458:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601472:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601478:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601502:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601839:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601847:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601854:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400514.601864:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1786400514.601964:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601971:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601976:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601981:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400514.601985:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.601994:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602005:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:3.0:1786400514.602009:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400514.602020:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602025:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5dce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602038:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602043:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602048:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602053:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400514.602055:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602060:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602067:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373a3445100) 00010000:00010000:3.0:1786400514.602070:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400514.602073:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602078:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5dd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602116:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5dc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 27 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602139:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 26 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.602159:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:3.0:1786400514.602161:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400514.602164:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031e00, rc 0) 00000100:00100000:3.0:1786400514.602227:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:11523:x1873176368859008:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 910us (1040us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1786400514.602234:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 189 00000100:00100000:3.0:1786400514.611349:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400514.611463:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368859136 00000100:00100000:2.0:1786400514.611472:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368859136 00000100:00100000:2.0:1786400514.611524:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 190 00000100:00100000:2.0:1786400514.611531:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:11523:x1873176368859136:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:2.0:1786400514.611598:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611617:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611627:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611662:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611677:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611682:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611686:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400514.611690:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611695:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611704:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:2.0:1786400514.611705:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400514.611708:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.611712:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5dea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400514.611808:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:11523:x1873176368859136:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 277us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400514.611816:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 190 00000100:00100000:3.0:1786400514.613179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400514.613223:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368859392 00000100:00100000:1.0:1786400514.613231:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368859392 00000100:00100000:1.0:1786400514.613287:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:1.0:1786400514.613297:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+26:11523:x1873176368859392:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:1.0:1786400514.613522:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:11523:x1873176368859392:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 225us (346us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1786400514.613529:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:1.0:1786400514.640187:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400514.640303:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368859648 00000100:00100000:3.0:1786400514.640312:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368859648 00000100:00100000:3.0:1786400514.640394:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 191 00000100:00100000:3.0:1786400514.640405:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:11049:x1873176368859648:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1786400514.640431:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400514.640449:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5df1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5382 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.640538:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.640549:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 28 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.640558:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.640608:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 28 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.640620:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 28 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400514.640630:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c91880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392973696:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400514.640717:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373840b8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400514.642622:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c91880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392973696:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400514.642664:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400514.644119:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400514.645041:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368859776 00000100:00100000:3.0:1786400514.645051:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368859776 00010000:00010000:3.0:1786400514.645100:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 29 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400514.645209:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:3.0:1786400514.645219:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:2361:x1873176368859776:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400514.645234:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400514.645240:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 29 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.645253:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 29 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.645275:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5ddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f537b expref: 29 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.645290:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:3.0:1786400514.645304:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.645313:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.645320:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.645353:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400514.645414:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+28:2361:x1873176368859776:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 196us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400514.645422:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 73 00010000:00010000:2.0:1786400514.645722:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.645767:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400514.645785:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1786400514.645942:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5df1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 29 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.645958:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 28 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.645965:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:2.0:1786400514.645967:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786400514.645970:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762600, rc 0) 00000100:00100000:2.0:1786400514.646006:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+28:11049:x1873176368859648:12345-192.168.201.23@tcp:101:bash.0 Request processed in 5603us (5829us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1786400514.646013:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 191 00000100:00100000:1.0:1786400514.648277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400514.648502:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368860032 00000100:00100000:2.0:1786400514.648512:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368860032 00000100:00100000:2.0:1786400514.648601:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 192 00000100:00100000:2.0:1786400514.648611:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+28:11049:x1873176368860032:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:2.0:1786400514.648939:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.648957:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.648968:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400514.649044:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1786400514.649069:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0a10f47 reply state 0000000027436939 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400514.649078:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1786400514.649126:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1786400514.649451:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11049:x1873176368860032:12345-192.168.201.23@tcp:36:bash.0 Request processed in 840us (1180us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1786400514.649460:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 192 00000020:00080000:2.0:1786400514.649464:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1786400514.651472:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.651489:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.651496:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.651501:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400514.651506:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.651514:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.651547:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:1.0:1786400514.651549:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400514.651555:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.651560:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5e06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400514.652513:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.652591:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368860160 00000100:00100000:0.0:1786400514.652600:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368860160 00000100:00100000:0.0:1786400514.652649:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 193 00000100:00100000:0.0:1786400514.652657:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:11049:x1873176368860160:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400514.652677:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400514.652694:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49800/0x49554f35ff0a5e0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5389 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.652782:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49800/0x49554f35ff0a5e0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5389 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.652813:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49800/0x49554f35ff0a5e0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5389 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.652833:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:0.0:1786400514.652836:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400514.652849:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49800, rc 0) 00000100:00100000:0.0:1786400514.652898:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11049:x1873176368860160:12345-192.168.201.23@tcp:101:bash.0 Request processed in 241us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400514.652906:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 193 00000100:00100000:0.0:1786400514.659164:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400514.659315:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368860288 00000100:00100000:2.0:1786400514.659326:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368860288 00000100:00100000:2.0:1786400514.659438:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:2.0:1786400514.659450:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:11049:x1873176368860288:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400514.659471:0:6623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400514.659491:0:6623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5390 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400514.659518:0:6623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a7a4efe, atime: 0x6a7a4efd, ctime: 0x6a7a4efe, blocks: 0xb 00010000:00010000:2.0:1786400514.659541:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=436s v=(0 0) 00010000:00010000:2.0:1786400514.659547:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400514.659556:0:6623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 8 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.659572:0:6623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 8 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.659604:0:6623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f200, rc 0) 00000100:00100000:2.0:1786400514.659679:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:11049:x1873176368860288:12345-192.168.201.23@tcp:101:bash.0 Request processed in 231us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400514.659686:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:1.0:1786400514.661990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400514.662163:0:6629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368860416 00000100:00100000:3.0:1786400514.662173:0:6629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368860416 00002000:00010000:3.0:1786400514.662225:0:6629:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1786400514.662231:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b7768380 with x1873176368860416 ext(0->18446744073709551615) 00002000:00010000:3.0:1786400514.662244:0:6629:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b7768380. 00000100:00100000:3.0:1786400514.662278:0:6629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1786400514.662287:0:6629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2360:x1873176368860416:12345-192.168.201.23@tcp:10:bash.0 00002000:00010000:3.0:1786400514.662572:0:6629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1786400514.662576:0:6629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1786400510 -> 1786400514 00002000:00010000:3.0:1786400514.662579:0:6629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1786400509 -> 1786400509 00002000:00010000:3.0:1786400514.662582:0:6629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1786400510 -> 1786400514 00002000:00010000:3.0:1786400514.662584:0:6629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1786400514.662642:0:6629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2360:x1873176368860416:12345-192.168.201.23@tcp:10:bash.0 Request processed in 356us (661us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1786400514.662651:0:6629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00002000:00010000:3.0:1786400514.662678:0:6629:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1786400514.662681:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b7768380 with x1873176368860416 ext(0->18446744073709551615) 00002000:00010000:3.0:1786400514.662687:0:6629:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b7768380. 00000100:00080000:0.0:1786400514.667961:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400514.719321:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.719439:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368860544 00000100:00100000:0.0:1786400514.719451:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368860544 00000100:00100000:0.0:1786400514.719520:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 194 00000100:00100000:0.0:1786400514.719530:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11537:x1873176368860544:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:0.0:1786400514.719608:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.719625:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.719637:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.719665:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.719672:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.719692:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720051:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720061:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720068:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400514.720111:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720123:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720130:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720136:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720150:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.720155:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720163:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720175:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400514.720183:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.720189:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720194:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720207:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720213:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720218:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720223:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.720225:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720230:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720238:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93739128d300) 00010000:00010000:0.0:1786400514.720241:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.720243:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720250:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720264:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720277:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720282:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720288:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.720291:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720298:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720307:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:0.0:1786400514.720309:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.720312:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.720318:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400514.720400:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11537:x1873176368860544:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 868us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400514.720409:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 194 00000100:00100000:2.0:1786400514.753709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.753890:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368860800 00000100:00100000:0.0:1786400514.753901:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368860800 00000100:00100000:0.0:1786400514.753964:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 195 00000100:00100000:0.0:1786400514.753974:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11540:x1873176368860800:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400514.753996:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400514.754029:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5397 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754103:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754118:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754129:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754154:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754162:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754169:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754491:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5e45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754501:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754509:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400514.754519:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1786400514.754611:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754633:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754639:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754645:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.754648:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754655:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754666:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400514.754669:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.754674:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754679:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754692:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754698:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754703:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754707:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.754717:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754723:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.754730:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93739128d300) 00010000:00010000:0.0:1786400514.754732:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.754734:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.755075:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.755119:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49200/0x49554f35ff0a5e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5397 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.755132:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5397 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.755148:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:0.0:1786400514.755150:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786400514.755153:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48200, rc 0) 00000100:00100000:0.0:1786400514.755230:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:11540:x1873176368860800:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1258us (1530us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1786400514.755239:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 195 00000100:00100000:1.0:1786400514.758818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.758996:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368860928 00000100:00100000:0.0:1786400514.759006:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368860928 00000100:00100000:0.0:1786400514.759071:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 196 00000100:00100000:0.0:1786400514.759082:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:11540:x1873176368860928:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:0.0:1786400514.759177:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.759194:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 34 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.759214:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.759250:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 34 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.759264:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 34 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400514.759278:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7763100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392973824:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400514.759517:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371240 going to sleep for 11 seconds 00000100:00100000:2.0:1786400514.763178:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.763310:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7763100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1873176392973824:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400514.763342:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400514.763457:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368861184 00000100:00100000:3.0:1786400514.763465:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368861184 00000100:00100000:3.0:1786400514.763526:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:3.0:1786400514.763536:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:5577:x1873176368861184:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786400514.764085:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+36:5577:x1873176368861184:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 549us (915us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1786400514.764094:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:2.0:1786400514.767509:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400514.767605:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368861312 00000100:00100000:1.0:1786400514.767616:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368861312 00010000:00010000:1.0:1786400514.767722:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 36 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400514.767824:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:1.0:1786400514.768060:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+36:2362:x1873176368861312:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400514.768078:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400514.768086:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 36 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.768101:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 36 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.768125:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5df8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5382 expref: 36 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.768170:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:1.0:1786400514.768176:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.768186:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.768266:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.768304:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400514.768440:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.768448:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.768483:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.768502:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.768509:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.768515:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.768520:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.768528:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.768537:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:0.0:1786400514.768539:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400514.768543:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.768548:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400514.768641:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:2362:x1873176368861312:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 807us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400514.768661:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:0.0:1786400514.768990:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:11540:x1873176368860928:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 9909us (10182us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400514.769000:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 196 00000100:00100000:0.0:1786400514.771716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400514.771984:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368861568 00000100:00100000:3.0:1786400514.771993:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368861568 00000100:00100000:3.0:1786400514.772095:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:3.0:1786400514.772106:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+34:11540:x1873176368861568:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400514.772368:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:11540:x1873176368861568:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 263us (716us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1786400514.772376:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:2.0:1786400514.845798:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.845901:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368861824 00000100:00100000:0.0:1786400514.845910:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368861824 00000100:00100000:0.0:1786400514.845974:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 197 00000100:00100000:0.0:1786400514.845984:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+35:11551:x1873176368861824:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:0.0:1786400514.846032:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400514.846053:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f539e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846122:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846167:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846180:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846207:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846215:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846222:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846532:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5e6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846830:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846852:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400514.846864:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1786400514.846970:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846977:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.846982:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847048:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.847054:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847062:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847074:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400514.847078:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.847082:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847089:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5e61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847102:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847109:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847115:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847120:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400514.847129:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847135:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847153:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93739128d300) 00010000:00010000:0.0:1786400514.847156:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400514.847159:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847164:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a5e68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847271:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5e5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f539e expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847284:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f539e expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.847292:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:0.0:1786400514.847294:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400514.847296:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48800, rc 0) 00000100:00100000:0.0:1786400514.847365:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:11551:x1873176368861824:12345-192.168.201.23@tcp:101:cat.0 Request processed in 1382us (1578us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1786400514.847373:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 197 00000100:00100000:2.0:1786400514.850837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400514.851036:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368862080 00000100:00100000:1.0:1786400514.851046:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368862080 00000100:00100000:1.0:1786400514.851098:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:1.0:1786400514.851108:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:11551:x1873176368862080:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:1.0:1786400514.851362:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:11551:x1873176368862080:12345-192.168.201.23@tcp:35:cat.0 Request processed in 254us (537us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1786400514.851370:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:1.0:1786400514.882064:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400514.882221:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368862336 00000100:00100000:2.0:1786400514.882233:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368862336 00000100:00100000:2.0:1786400514.882300:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 198 00000100:00100000:2.0:1786400514.882312:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:11552:x1873176368862336:12345-192.168.201.23@tcp:36:rm.0 00010000:00010000:2.0:1786400514.882378:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786400514.882410:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48800/0x49554f35ff0a5e6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f539e expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.882435:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48200/0x49554f35ff0a5e45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5397 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.882448:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49800/0x49554f35ff0a5e0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5389 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.882459:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9373a3445400) 00010000:00010000:2.0:1786400514.882471:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400514.882513:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.882527:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.882537:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.883016:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.883029:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.883037:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.883361:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.883371:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.883379:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400514.885473:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1786400514.885487:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436626747115ns, next at 437626744233ns, rc = 0 00010000:00010000:2.0:1786400514.885726:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.885778:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.885800:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.885809:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.885816:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.885821:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886012:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400514.886037:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886044:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886049:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886055:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400514.886059:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886066:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886078:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801200) 00010000:00010000:2.0:1786400514.886081:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786400514.886091:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886097:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5e8b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886134:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886151:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886157:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886163:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ec00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400514.886166:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886172:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886181:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400514.886183:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400514.886186:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400514.886192:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5e7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400514.886213:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d2aff99 reply state 0000000098323934 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400514.886233:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400514.886333:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+37:11552:x1873176368862336:12345-192.168.201.23@tcp:36:rm.0 Request processed in 4019us (4275us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1786400514.886342:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 198 00010000:00010000:3.0:1786400514.889968:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.889985:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.889993:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.889998:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400514.890019:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.890027:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.890045:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff937386801d00) 00010000:00010000:3.0:1786400514.890048:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400514.890052:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.890058:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fa00/0x49554f35ff0a5e84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.894480:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400514.894497:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.894528:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400514.894533:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.894549:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.894567:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff937386801200) 00010000:00010000:0.0:1786400514.894570:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786400514.894575:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.894581:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5e92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.894618:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400514.894620:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400514.894622:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400514.945410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400514.945492:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368862592 00000100:00100000:3.0:1786400514.945500:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368862592 00000100:00100000:3.0:1786400514.945567:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 199 00000100:00100000:3.0:1786400514.945577:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+36:11558:x1873176368862592:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1786400514.945602:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400514.945627:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5e99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53a5 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.945775:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.945789:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.945796:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.945821:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.945825:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.945829:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786400514.946318:0:8098:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1786400514.946443:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946450:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946455:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946479:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946484:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946488:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946491:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400514.946494:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946507:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946516:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:3.0:1786400514.946518:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400514.946521:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946526:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a5ea0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786400514.946539:0:8098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061c8ef01 reply state 0000000075da79d4 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400514.946547:0:8098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786400514.946575:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763200/0x49554f35ff0a5e99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 39 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946589:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 38 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400514.946594:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445400) 00010000:00010000:3.0:1786400514.946596:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400514.946597:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031e00, rc 0) 00000100:00100000:3.0:1786400514.946678:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:11558:x1873176368862592:12345-192.168.201.23@tcp:101:bash.0 Request processed in 1103us (1278us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1786400514.946686:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 199 00010000:00010000:1.0:1786400514.948703:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.948716:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.948733:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.948757:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400514.948761:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.948766:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.948779:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373a3445100) 00010000:00010000:1.0:1786400514.948780:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400514.948783:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400514.948787:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a5ea7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400514.954973:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.955726:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368862720 00000100:00100000:0.0:1786400514.955771:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368862720 00000100:00100000:0.0:1786400514.955856:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:0.0:1786400514.955867:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368862720:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400514.955888:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400514.955910:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53ac expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786400514.955940:0:6622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786400514.955961:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=436s v=(0 0) 00010000:00010000:0.0:1786400514.955966:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400514.955991:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 6 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.956011:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 6 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.956026:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49e00, rc 0) 00000100:00100000:0.0:1786400514.956091:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368862720:12345-192.168.201.23@tcp:101:bash.0 Request processed in 226us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400514.956099:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00080000:1.0:1786400514.956211:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400514.975635:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.975873:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368862848 00000100:00100000:0.0:1786400514.975882:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368862848 00000100:00100000:0.0:1786400514.975937:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:0.0:1786400514.975949:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:11558:x1873176368862848:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400514.975969:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400514.975992:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53b3 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.976029:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 7 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.976039:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400514.976044:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400514.976051:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.976089:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 7 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.976117:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 7 pid: 6622 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400514.976132:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6624:1873176392973952:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400514.976254:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400514.984042:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6624:1873176392973952:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400514.984077:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.984100:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48600, rc 0) 00000100:00100000:0.0:1786400514.984168:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:11558:x1873176368862848:12345-192.168.201.23@tcp:101:bash.0 Request processed in 8221us (8542us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400514.984177:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:1.0:1786400514.984363:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400514.984537:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368862976 00000100:00100000:0.0:1786400514.984601:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368862976 00010000:00010000:0.0:1786400514.984691:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 7 pid: 6622 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400514.984727:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:0.0:1786400514.984945:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368862976:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400514.984963:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400514.984990:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 7 pid: 6622 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.985024:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 7 pid: 6622 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.985051:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f85de343/0x49554f35ff0a5ebc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ac expref: 7 pid: 6622 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.985067:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400514.985071:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400514.985080:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.985091:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400514.985125:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400514.985147:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1873176392974080:192.168.201.23@tcp:105: 00000100:00100000:0.0:1786400514.985219:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371240 going to sleep for 11 seconds 00000100:00100000:1.0:1786400514.995586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400514.997376:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368863232 00000100:00100000:2.0:1786400514.997390:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368863232 00000100:00100000:2.0:1786400514.997457:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:2.0:1786400514.997468:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+38:11558:x1873176368863232:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:2.0:1786400514.997876:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:11558:x1873176368863232:12345-192.168.201.23@tcp:35:bash.0 Request processed in 409us (2299us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1786400514.997885:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:0.0:1786400515.003599:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1873176392974080:192.168.201.23@tcp:105: 00010000:00010000:0.0:1786400515.003628:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400515.003712:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2361:x1873176368862976:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 18974us (19348us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.003725:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:1.0:1786400515.175537:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.175647:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368863360 00000100:00100000:0.0:1786400515.175657:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368863360 00000100:00100000:0.0:1786400515.175719:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 200 00000100:00100000:0.0:1786400515.175729:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+39:11574:x1873176368863360:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400515.175797:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.175821:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.175890:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5ed1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.175904:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.175914:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400515.175973:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1786400515.175976:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400515.175996:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.176020:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5eca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ba expref: 41 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.176036:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ba expref: 40 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.176045:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400515.176048:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400515.176066:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49600, rc 0) 00000100:00100000:0.0:1786400515.176129:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:11574:x1873176368863360:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 402us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.176147:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 200 00000100:00100000:3.0:1786400515.181099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.181334:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368863616 00000100:00100000:2.0:1786400515.181344:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368863616 00000100:00100000:2.0:1786400515.181397:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 201 00000100:00100000:2.0:1786400515.181407:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+40:11574:x1873176368863616:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400515.181428:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400515.181445:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5ed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53c1 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.181567:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5edf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.181581:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.181593:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400515.181613:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1786400515.181790:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5ed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53c1 expref: 43 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.181804:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53c1 expref: 42 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.181810:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445400) 00010000:00010000:2.0:1786400515.181812:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400515.181814:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f800, rc 0) 00000100:00100000:2.0:1786400515.181860:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+42:11574:x1873176368863616:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 455us (768us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1786400515.181866:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 201 00000100:00100000:1.0:1786400515.185409:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.185512:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368863744 00000100:00100000:0.0:1786400515.185524:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368863744 00000100:00100000:0.0:1786400515.185631:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1786400515.185642:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+42:2361:x1873176368863744:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400515.185657:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400515.185682:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5edf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53c1 expref: 42 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.185701:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445400) 00010000:00010000:0.0:1786400515.185706:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400515.186042:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+41:2361:x1873176368863744:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 401us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.186051:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1786400515.186515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.186632:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368864000 00000100:00100000:0.0:1786400515.186638:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368864000 00000100:00100000:0.0:1786400515.186679:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 202 00000100:00100000:0.0:1786400515.186687:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+41:11574:x1873176368864000:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400515.186707:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.186723:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.186863:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5ef4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.186897:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.186907:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400515.186920:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1786400515.187045:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a5eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53c8 expref: 44 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.187062:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53c8 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.187070:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445400) 00010000:00010000:0.0:1786400515.187073:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786400515.187077:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48000, rc 0) 00000100:00100000:0.0:1786400515.187128:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:11574:x1873176368864000:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 442us (615us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1786400515.187142:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 202 00000100:00100000:1.0:1786400515.190892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.190929:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368864128 00000100:00100000:0.0:1786400515.190939:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368864128 00000100:00100000:0.0:1786400515.190999:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:0.0:1786400515.191006:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+6:2362:x1873176368864128:12345-192.168.201.23@tcp:1:lfs.0 00010000:00010000:0.0:1786400515.191051:0:10836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.191071:0:10836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.191095:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400515.191099:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400515.191103:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.191148:0:10836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.191162:0:10836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 6 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.191175:0:10836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7760380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10836:1873176392974208:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400515.191351:0:10836:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400515.196442:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.196468:0:10836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7760380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10836:1873176392974208:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400515.196496:0:10836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400515.196622:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368864256 00000100:00100000:1.0:1786400515.196629:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368864256 00002000:00100000:1.0:1786400515.196678:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff937388c90380 x1873176368864256/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:311/0 lens 504/0 e 0 to 0 dl 1786400526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400515.196695:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff937388c90380 with x1873176368864256 ext(0->8) 00010000:00010000:1.0:1786400515.196701:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 7 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.196712:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 7 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400515.196717:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff937388c90380 00000100:00100000:1.0:1786400515.196783:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:1.0:1786400515.196792:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368864256:12345-192.168.201.23@tcp:4:lfs.0 00000100:00100000:1.0:1786400515.197241:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2362:x1873176368864256:12345-192.168.201.23@tcp:4:lfs.0 Request processed in 448us (808us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1786400515.197249:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00002000:00100000:1.0:1786400515.197256:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff937388c90380 x1873176368864256/t4294967308(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:311/0 lens 504/448 e 0 to 0 dl 1786400526 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400515.197264:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff937388c90380 with x1873176368864256 ext(0->8) 00010000:00010000:1.0:1786400515.197270:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 9 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.197280:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 9 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400515.197287:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff937388c90380 00000100:00100000:3.0:1786400515.203413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.203528:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368864384 00000100:00100000:0.0:1786400515.203547:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368864384 00010000:00010000:0.0:1786400515.203590:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 9 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.203632:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:0.0:1786400515.203652:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2359:x1873176368864384:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400515.203683:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786400515.203702:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1786400515.203704:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786400514 00002000:00010000:0.0:1786400515.203706:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786400515 00002000:00010000:0.0:1786400515.203708:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1786400514 00010000:00010000:0.0:1786400515.203714:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 9 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.203727:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 9 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.203781:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d01b4ef/0x49554f35ff0a5ec3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53b3 expref: 9 pid: 6624 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.203798:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400515.203803:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400515.203809:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.203818:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.203854:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400515.203917:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2359:x1873176368864384:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 276us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.203925:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 76 00010000:00010000:1.0:1786400515.204573:0:10836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.204594:0:10836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.204638:0:10836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.204653:0:10836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.204661:0:10836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.204667:0:10836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400515.204672:0:10836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.204680:0:10836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.204694:0:10836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.204700:0:10836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7019bce/0x49554f35ff0a5f02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400515.204824:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368864128:12345-192.168.201.23@tcp:1:lfs.0 Request processed in 13816us (13939us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400515.204833:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1786400515.213901:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.214651:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368864640 00000100:00100000:2.0:1786400515.214660:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368864640 00000100:00100000:2.0:1786400515.214710:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:2.0:1786400515.214717:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390226050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+43:11574:x1873176368864640:12345-192.168.201.23@tcp:35:lfs.0 00000004:00010000:2.0:1786400515.214789:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53c8 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400515.215025:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1786400515.215067:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1786400515.215444:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1786400515.215498:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.215530:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 47 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.215692:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.215733:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 47 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.215778:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 47 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.215792:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7988a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5820:1873176392974336:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400515.215885:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730e40 going to sleep for 11 seconds 00010000:00010000:0.0:1786400515.219029:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400515.231299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.231439:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7988a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5820:1873176392974336:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400515.231469:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.237071:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368864768 00000100:00100000:0.0:1786400515.237084:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368864768 00010000:00010000:0.0:1786400515.237145:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 48 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.237201:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:0.0:1786400515.237211:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+48:2361:x1873176368864768:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400515.237225:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400515.237231:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 48 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.237246:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 48 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.237267:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a5eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53a5 expref: 48 pid: 8098 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.237289:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445400) 00010000:00010000:0.0:1786400515.237293:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.237300:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.237304:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.237321:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400515.237392:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+47:2361:x1873176368864768:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 184us (6104us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.237398:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 77 00010000:00010000:1.0:1786400515.238095:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.238106:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400515.238262:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1786400515.238489:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1786400515.238615:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392974464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786400515.239153:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400515.239271:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390910c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400515.239518:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392974464 00000100:00100000:2.0:1786400515.239524:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392974464 00000100:00100000:2.0:1786400515.239581:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786400515.239591:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1873176392974464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786400515.239684:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1873176392974464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400515.239691:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786400515.240040:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392974464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1786400515.240502:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1786400515.240575:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392974592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786400515.240609:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400515.240625:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390910840 going to sleep for 11 seconds 00000100:00100000:2.0:1786400515.241031:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392974592 00000100:00100000:2.0:1786400515.241038:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392974592 00000100:00100000:2.0:1786400515.241071:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400515.241076:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1873176392974592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786400515.241335:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5820:x1873176392974592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 257us (725us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1786400515.241340:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786400515.241533:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1873176392974592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1786400515.241763:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1786400515.241806:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.241814:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.241820:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.241823:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400515.241827:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.241833:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.241846:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445400) 00010000:00010000:1.0:1786400515.241848:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786400515.241851:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.241855:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400515.241982:0:5820:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1786400515.242072:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1786400515.242082:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 436983341967ns, next at 437983339954ns, rc = 0 00000001:00080000:1.0:1786400515.242087:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1786400515.242109:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445400) 00010000:00010000:1.0:1786400515.242112:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786400515.242118:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a5ef4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53c8 expref: 51 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400515.242952:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390226050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:11574:x1873176368864640:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 28231us (29058us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1786400515.242962:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00000020:00080000:1.0:1786400515.242967:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1786400515.258866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400515.259436:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368864896 00000100:00100000:3.0:1786400515.259450:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368864896 00000100:00100000:3.0:1786400515.259518:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 203 00000100:00100000:3.0:1786400515.259529:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+50:11574:x1873176368864896:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400515.259563:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400515.259587:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53cf expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.259862:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53cf expref: 51 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.259880:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53cf expref: 51 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.259905:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400515.259908:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786400515.259912:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:3.0:1786400515.259983:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:11574:x1873176368864896:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 455us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.259991:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 203 00000100:00100000:3.0:1786400515.270445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.271676:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368865152 00000100:00100000:2.0:1786400515.271689:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368865152 00000100:00100000:2.0:1786400515.271796:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:2.0:1786400515.271809:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+51:11574:x1873176368865152:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400515.272086:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:11574:x1873176368865152:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 277us (1650us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1786400515.272095:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:2.0:1786400515.363513:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.363580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.363627:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.364373:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368865536 00000100:00100000:1.0:1786400515.364384:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368865536 00000100:00100000:1.0:1786400515.364467:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 171 00000100:00100000:1.0:1786400515.364478:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368865536:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400515.364566:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2360:x1873176368865536:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 91us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400515.364575:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 171 00000100:00100000:3.0:1786400515.364782:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368865280 00000100:00100000:3.0:1786400515.364787:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368865280 00000100:00100000:0.0:1786400515.364799:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368865408 00000100:00100000:0.0:1786400515.364803:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368865408 00000100:00100000:3.0:1786400515.364828:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 302 00000100:00100000:0.0:1786400515.364832:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:3.0:1786400515.364835:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368865280:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400515.364838:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2360:x1873176368865408:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400515.364866:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2360:x1873176368865408:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.364873:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:3.0:1786400515.364886:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368865280:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 52us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.364893:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 302 00000100:00080000:2.0:1786400515.366240:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400515.432084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.432631:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368865664 00000100:00100000:0.0:1786400515.432642:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368865664 00000100:00100000:0.0:1786400515.432709:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 204 00000100:00100000:0.0:1786400515.432720:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:11584:x1873176368865664:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:0.0:1786400515.432838:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.432859:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.432873:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.432889:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.432895:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.432901:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433010:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433017:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433024:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400515.433063:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433075:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433081:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433088:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433094:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400515.433098:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433106:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433118:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400515.433122:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400515.433126:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433149:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48c00/0x49554f35ff0a5f17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433163:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433168:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433174:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433179:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400515.433182:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433188:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433196:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93739128d900) 00010000:00010000:0.0:1786400515.433199:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400515.433201:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433206:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433221:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433226:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433239:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433244:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48a00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400515.433247:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433254:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433262:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400515.433265:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400515.433267:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.433273:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5f25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.433414:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:11584:x1873176368865664:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 695us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.433423:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 204 00000100:00100000:1.0:1786400515.475558:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392974720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400515.475652:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400515.476344:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392974720 00000100:00100000:2.0:1786400515.476354:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392974720 00000100:00100000:2.0:1786400515.476435:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786400515.476446:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1873176392974720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400515.476483:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400515.476556:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1873176392974720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400515.476563:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786400515.477829:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392974720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786400515.483335:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400515.498727:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.498991:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368865920 00000100:00100000:1.0:1786400515.499003:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368865920 00000100:00100000:1.0:1786400515.499055:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 205 00000100:00100000:1.0:1786400515.499065:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+52:11587:x1873176368865920:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400515.499089:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400515.499109:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5f2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499202:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499218:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499245:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499260:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499268:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499276:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499400:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499409:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499416:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400515.499426:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1786400515.499517:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499524:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499531:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499537:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebee00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400515.499547:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499555:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499568:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:1.0:1786400515.499571:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400515.499575:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499582:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a5f33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499606:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499613:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499620:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499626:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400515.499629:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499635:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499642:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373850bff00) 00010000:00010000:1.0:1786400515.499644:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400515.499653:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499659:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499698:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5f2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53d6 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499711:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53d6 expref: 54 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.499719:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:1.0:1786400515.499722:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400515.499724:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebea00, rc 0) 00000100:00100000:1.0:1786400515.500084:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:11587:x1873176368865920:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1018us (1365us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1786400515.500093:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 205 00000100:00100000:2.0:1786400515.507681:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400515.508242:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368866048 00000100:00100000:3.0:1786400515.508255:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368866048 00000100:00100000:3.0:1786400515.508329:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 206 00000100:00100000:3.0:1786400515.508341:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:11587:x1873176368866048:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:3.0:1786400515.508417:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508437:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508450:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508475:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508482:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508488:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508494:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400515.508498:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508522:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508534:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400515.508537:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400515.508542:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.508548:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a5f4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400515.509259:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:11587:x1873176368866048:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 917us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.509270:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 206 00000100:00100000:0.0:1786400515.513666:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.517262:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368866304 00000100:00100000:2.0:1786400515.517277:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368866304 00000100:00100000:2.0:1786400515.517409:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:2.0:1786400515.517420:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+54:11587:x1873176368866304:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400515.518035:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:11587:x1873176368866304:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 611us (4374us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1786400515.518044:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:0.0:1786400515.616806:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.617293:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368866560 00000100:00100000:1.0:1786400515.617306:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368866560 00000100:00100000:1.0:1786400515.617431:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 207 00000100:00100000:1.0:1786400515.617444:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+55:11597:x1873176368866560:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1786400515.617470:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400515.617474:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786400515.617503:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49600/0x49554f35ff0a5ed1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53ba expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.617524:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:1.0:1786400515.617529:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400515.617560:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5f56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.617801:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.617815:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.617828:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400515.618070:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1786400515.618308:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a5f56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53dd expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.618325:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53dd expref: 56 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.618333:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:1.0:1786400515.618336:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400515.618339:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebfa00, rc 0) 00000100:00100000:1.0:1786400515.618412:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:11597:x1873176368866560:12345-192.168.201.23@tcp:101:bash.0 Request processed in 972us (1616us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1786400515.618421:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 207 00000100:00100000:3.0:1786400515.621709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.622604:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368866816 00000100:00100000:2.0:1786400515.622620:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368866816 00000100:00100000:2.0:1786400515.623146:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 208 00000100:00100000:2.0:1786400515.623160:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+56:11597:x1873176368866816:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:2.0:1786400515.623236:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786400515.623266:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a5f5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53dd expref: 56 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.623291:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a5f41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53d6 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.623302:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:2.0:1786400515.623308:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400515.623543:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.623557:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.623568:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400515.623625:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1786400515.623825:0:5817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000617009ce reply state 0000000082170ded transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.623836:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400515.624070:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11597:x1873176368866816:12345-192.168.201.23@tcp:36:bash.0 Request processed in 913us (2371us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1786400515.624078:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 208 00000020:00080000:2.0:1786400515.624083:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786400515.626977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.627012:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368866944 00000100:00100000:0.0:1786400515.627023:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368866944 00000100:00100000:0.0:1786400515.627073:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 209 00000100:00100000:0.0:1786400515.627098:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11597:x1873176368866944:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400515.627134:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.627156:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5f72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53e4 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.627251:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.627267:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.627275:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.627295:0:8098:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.627306:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628075:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628089:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628096:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628102:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400515.628105:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628113:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628158:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400515.628160:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400515.628164:0:3302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628172:0:3302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628178:0:3302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628223:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.628230:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e200/0x49554f35ff0a5f6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.628363:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.628371:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400515.628414:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1786400515.628418:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400515.628441:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.628472:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 58 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.628496:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 57 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.628503:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400515.628506:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400515.628508:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49000, rc 0) 00000100:00100000:0.0:1786400515.628580:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11597:x1873176368866944:12345-192.168.201.23@tcp:101:bash.0 Request processed in 1483us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.628589:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 209 00000100:00100000:0.0:1786400515.631812:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.632028:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368867200 00000100:00100000:1.0:1786400515.632039:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368867200 00000100:00100000:1.0:1786400515.632106:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:1.0:1786400515.632117:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+57:11597:x1873176368867200:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:1.0:1786400515.632535:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11597:x1873176368867200:12345-192.168.201.23@tcp:35:bash.0 Request processed in 419us (731us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1786400515.632544:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:3.0:1786400515.703920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.704040:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368867328 00000100:00100000:0.0:1786400515.704053:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368867328 00000100:00100000:0.0:1786400515.704135:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 210 00000100:00100000:0.0:1786400515.704147:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+58:11603:x1873176368867328:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400515.704174:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.704205:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53eb expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.704275:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.704291:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.704304:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400515.704391:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1786400515.704395:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400515.704421:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.704447:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53eb expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.704464:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53eb expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.704473:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400515.704476:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400515.704480:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48400, rc 0) 00000100:00100000:0.0:1786400515.704551:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11603:x1873176368867328:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 407us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.704560:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 210 00000100:00100000:0.0:1786400515.708596:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.708699:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368867456 00000100:00100000:2.0:1786400515.708709:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368867456 00000100:00100000:2.0:1786400515.708811:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 211 00000100:00100000:2.0:1786400515.708821:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11603:x1873176368867456:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400515.708855:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400515.708875:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53f2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.708940:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.708954:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.708965:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.708978:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.708985:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709009:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709110:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709119:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709137:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400515.709177:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1786400515.709412:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400515.709441:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709453:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709462:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709468:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709474:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709481:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400515.709485:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709501:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709515:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400515.709518:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400515.709523:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709529:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5f95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709544:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709549:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709554:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709559:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400515.709562:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709568:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709575:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff937386801e00) 00010000:00010000:2.0:1786400515.709577:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400515.709580:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709596:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5f9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709632:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a5f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f2 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709645:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f2 expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.709652:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:2.0:1786400515.709654:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400515.709656:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f800, rc 0) 00000100:00100000:2.0:1786400515.709721:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11603:x1873176368867456:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 901us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400515.709729:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 211 00000100:00100000:1.0:1786400515.714044:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.714147:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368867712 00000100:00100000:0.0:1786400515.714157:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368867712 00000100:00100000:0.0:1786400515.714230:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 212 00000100:00100000:0.0:1786400515.714241:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11603:x1873176368867712:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400515.714263:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.714283:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5faa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f53f9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.714384:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.714414:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 61 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.714423:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f2 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.714430:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.714460:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f2 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.714473:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f2 expref: 61 pid: 5817 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.714487:0:5816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7762680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1873176392974848:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400515.714591:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 61 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.714601:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 61 pid: 8098 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.714609:0:5816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7761180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1873176392974976:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400515.714975:0:5816:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371e40 going to sleep for 11 seconds 00010000:00010000:0.0:1786400515.717822:0:5816:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.23@tcp) returned -22 from blocking AST (req@000000006cbd1e9b x1873176392974848) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f2 expref: 61 pid: 5817 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.717863:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f2 expref: 61 pid: 5817 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.717888:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a5fa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f2 expref: 61 pid: 5817 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.717904:0:5816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7762680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1873176392974848:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400515.717920:0:5816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7761180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1873176392974976:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400515.717945:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400515.717950:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.717960:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.717968:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400515.719692:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.720254:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.720374:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368867968 00000100:00100000:0.0:1786400515.720383:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368867968 00010000:00010000:0.0:1786400515.720425:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 61 pid: 8098 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.720463:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368867840 00000100:00100000:0.0:1786400515.720466:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368867840 00000100:00100000:0.0:1786400515.720483:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:0.0:1786400515.720491:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:2359:x1873176368867968:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400515.720518:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400515.720525:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 62 pid: 8098 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.720538:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 62 pid: 8098 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.720559:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49000/0x49554f35ff0a5f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53e4 expref: 62 pid: 8098 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.720574:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400515.720579:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.720588:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.720595:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.720634:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400515.720687:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:2359:x1873176368867968:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 196us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.720696:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:0.0:1786400515.720715:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:0.0:1786400515.720722:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:2359:x1873176368867840:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400515.720732:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400515.720735:0:5800:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 49554f35ff0a5fa3) 00010000:00010000:0.0:1786400515.720768:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400515.720789:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:2359:x1873176368867840:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 67us (536us total) trans 0 rc 116/116 00000100:00100000:0.0:1786400515.720795:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00010000:00010000:2.0:1786400515.720877:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.720885:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400515.720904:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1786400515.721055:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49a00/0x49554f35ff0a5faa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.721070:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.721087:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:2.0:1786400515.721090:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786400515.721092:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48a00, rc 0) 00000100:00100000:2.0:1786400515.721119:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11603:x1873176368867712:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 6882us (7087us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1786400515.721135:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 212 00000100:00100000:3.0:1786400515.725169:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.725327:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368868224 00000100:00100000:0.0:1786400515.725339:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368868224 00000100:00100000:0.0:1786400515.725442:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:0.0:1786400515.725453:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11603:x1873176368868224:12345-192.168.201.23@tcp:103:lfs.0 00010000:00010000:0.0:1786400515.725469:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400515.725495:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a5f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53cf expref: 60 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.725513:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400515.725517:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400515.725579:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11603:x1873176368868224:12345-192.168.201.23@tcp:103:lfs.0 Request processed in 128us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.725586:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:3.0:1786400515.727533:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.727639:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368868352 00000100:00100000:2.0:1786400515.727648:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368868352 00000100:00100000:2.0:1786400515.727702:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 213 00000100:00100000:2.0:1786400515.727712:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11603:x1873176368868352:12345-192.168.201.23@tcp:58:lfs.0 00010000:00010000:2.0:1786400515.727858:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.727876:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.727888:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400515.728145:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1786400515.728238:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11603:x1873176368868352:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 526us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400515.728245:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 213 00000100:00100000:2.0:1786400515.730642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400515.730779:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368868480 00000100:00100000:3.0:1786400515.730791:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368868480 00000100:00100000:3.0:1786400515.730856:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 214 00000100:00100000:3.0:1786400515.730866:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+59:11603:x1873176368868480:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400515.730885:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400515.730905:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5400 expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.730962:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.730984:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5400 expref: 60 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.731003:0:8098:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.731017:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5400 expref: 60 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.731030:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400515.731033:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786400515.731037:0:8098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5400 expref: 60 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.731045:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030600, rc 0) 00000100:00100000:3.0:1786400515.731097:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11603:x1873176368868480:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 233us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.731106:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 214 00000040:00080000:1.0:1786400515.734161:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400515.734171:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400515.734296:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1786400515.734305:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400515.734431:0:11579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b776aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392975104:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786400515.734575:0:11579:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390910240 going to sleep for 11 seconds 00000100:00100000:2.0:1786400515.738933:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.739060:0:11579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b776aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392975104:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400515.739430:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368868608 00000100:00100000:3.0:1786400515.739439:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368868608 00000100:00100000:3.0:1786400515.739502:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 215 00000100:00100000:3.0:1786400515.739513:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11604:x1873176368868608:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786400515.739547:0:5818:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786400515.739655:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11604:x1873176368868608:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 143us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.739663:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 215 00000100:00100000:3.0:1786400515.742490:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.742595:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368868736 00000100:00100000:1.0:1786400515.742605:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368868736 00000100:00100000:1.0:1786400515.742674:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 216 00000100:00100000:1.0:1786400515.742684:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11604:x1873176368868736:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786400515.742792:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742810:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742822:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742851:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742876:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742883:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742908:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742916:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742923:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400515.742961:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1786400515.742974:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400515.742985:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.742995:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743001:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743009:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743015:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400515.743019:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743032:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743045:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:1.0:1786400515.743048:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400515.743052:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743059:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a5fcd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743071:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743077:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743083:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743088:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfe00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400515.743091:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743097:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743103:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9373850bff00) 00010000:00010000:1.0:1786400515.743105:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400515.743107:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743133:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a5fd4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743149:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743155:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743162:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743167:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400515.743170:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743309:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743321:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:1.0:1786400515.743323:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400515.743326:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.743330:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a5fdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400515.743407:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11604:x1873176368868736:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 724us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400515.743417:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 216 00000100:00100000:1.0:1786400515.746782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400515.747092:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368868992 00000100:00100000:3.0:1786400515.747103:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368868992 00000100:00100000:2.0:1786400515.747266:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 217 00000100:00100000:2.0:1786400515.747282:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+60:11604:x1873176368868992:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400515.747318:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400515.747341:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5fe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5407 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747453:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747468:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747481:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400515.747492:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1786400515.747595:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747603:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747610:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747616:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400515.747620:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747628:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747640:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:2.0:1786400515.747650:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786400515.747656:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747661:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e600/0x49554f35ff0a5fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747703:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5fe2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5407 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747715:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:2.0:1786400515.747718:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400515.747722:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a5fe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5407 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.747732:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e800, rc 0) 00000100:00100000:2.0:1786400515.747837:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11604:x1873176368868992:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 560us (1100us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1786400515.747857:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 217 00000100:00100000:3.0:1786400515.752533:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.752791:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368869120 00000100:00100000:1.0:1786400515.752804:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368869120 00000100:00100000:1.0:1786400515.752873:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 218 00000100:00100000:1.0:1786400515.752883:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11604:x1873176368869120:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786400515.752922:0:8098:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786400515.753468:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11604:x1873176368869120:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 584us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400515.753476:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 218 00000100:00100000:0.0:1786400515.758366:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.758452:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368869376 00000100:00100000:2.0:1786400515.758463:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368869376 00000100:00100000:2.0:1786400515.758529:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 219 00000100:00100000:2.0:1786400515.758540:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11604:x1873176368869376:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400515.758563:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400515.758566:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786400515.758595:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48400/0x49554f35ff0a5f87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53eb expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.758616:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:2.0:1786400515.758646:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400515.758663:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5ff7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f540e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400515.759413:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1786400515.759614:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.760100:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.760116:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.762161:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a5ff7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f540e expref: 63 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.762337:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f540e expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.762347:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff937386801e00) 00010000:00010000:2.0:1786400515.762350:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400515.762354:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e400, rc 0) 00000100:00100000:2.0:1786400515.762513:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:11604:x1873176368869376:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 3974us (4157us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1786400515.762522:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 219 00000100:00100000:2.0:1786400515.767581:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.767807:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368869632 00000100:00100000:0.0:1786400515.767817:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368869632 00000100:00100000:0.0:1786400515.767881:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 220 00000100:00100000:0.0:1786400515.767891:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:11604:x1873176368869632:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786400515.767961:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400515.767988:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a5ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f540e expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768008:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff937386801e00) 00010000:00010000:0.0:1786400515.768034:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400515.768056:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768070:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768080:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768094:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768101:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768106:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768316:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768323:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768329:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768335:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400515.768339:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768345:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768362:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400515.768364:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400515.768367:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768373:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a600c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768382:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768388:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768394:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768398:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400515.768401:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768405:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768411:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd806364f (ffff93739128d900) 00010000:00010000:0.0:1786400515.768413:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400515.768415:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.768420:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6013 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd806364f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.768508:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11604:x1873176368869632:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 617us (935us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400515.768516:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 220 00000100:00100000:2.0:1786400515.771558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.771647:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368869760 00000100:00100000:0.0:1786400515.771657:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368869760 00000100:00100000:0.0:1786400515.771715:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 221 00000100:00100000:0.0:1786400515.771726:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+61:11604:x1873176368869760:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400515.771775:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.771800:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a601a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5415 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.771836:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.771862:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.771873:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.771977:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a601a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 63 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.771995:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 62 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.772002:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:0.0:1786400515.772011:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786400515.772015:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48600, rc 0) 00000100:00100000:0.0:1786400515.772068:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:11604:x1873176368869760:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 344us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.772074:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 221 00000100:00100000:2.0:1786400515.775269:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.775372:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368870016 00000100:00100000:0.0:1786400515.775382:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368870016 00000100:00100000:0.0:1786400515.775442:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 222 00000100:00100000:0.0:1786400515.775453:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+62:11604:x1873176368870016:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786400515.775568:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.775584:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.775595:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786400515.775873:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1786400515.775963:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6f0e476 reply state 000000008a77fd9b transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.775974:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786400515.776055:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+64:11604:x1873176368870016:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 603us (794us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1786400515.776063:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 222 00010000:00010000:0.0:1786400515.778789:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.778807:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.778834:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.778840:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400515.778845:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.778853:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.778868:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:0.0:1786400515.778872:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786400515.778876:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.778882:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.779623:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.779708:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368870144 00000100:00100000:0.0:1786400515.779718:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368870144 00000100:00100000:0.0:1786400515.779811:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 223 00000100:00100000:0.0:1786400515.779822:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+63:11604:x1873176368870144:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400515.779847:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.779864:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f541c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.779925:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 64 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.779954:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 64 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.779977:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:0.0:1786400515.779980:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400515.779984:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49e00, rc 0) 00000100:00100000:0.0:1786400515.780038:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+64:11604:x1873176368870144:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 218us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.780045:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 223 00000100:00100000:1.0:1786400515.782336:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.782415:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368870272 00000100:00100000:0.0:1786400515.782425:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368870272 00000100:00100000:0.0:1786400515.782483:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:0.0:1786400515.782492:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2361:x1873176368870272:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1786400515.782829:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2361:x1873176368870272:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 337us (501us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1786400515.782837:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:1.0:1786400515.785521:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.785610:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368870528 00000100:00100000:2.0:1786400515.785619:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368870528 00000100:00100000:2.0:1786400515.785684:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:2.0:1786400515.785694:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+64:11604:x1873176368870528:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786400515.785941:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+65:11604:x1873176368870528:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 248us (428us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1786400515.785948:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:3.0:1786400515.787892:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.788105:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368870784 00000100:00100000:0.0:1786400515.788114:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368870784 00000100:00100000:0.0:1786400515.788191:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 224 00000100:00100000:0.0:1786400515.788201:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+65:11604:x1873176368870784:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786400515.788307:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+65:11604:x1873176368870784:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 108us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.788315:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 224 00000100:00100000:3.0:1786400515.790516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.790620:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368870912 00000100:00100000:0.0:1786400515.790642:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368870912 00000100:00100000:0.0:1786400515.790698:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 225 00000100:00100000:0.0:1786400515.790707:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+65:11604:x1873176368870912:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400515.790726:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.790784:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6036 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5423 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.790976:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a603d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.790990:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a603d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.791001:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a603d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400515.791038:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400515.791056:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a603d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.791082:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48000/0x49554f35ff0a6036 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5423 expref: 67 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.791099:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a603d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5423 expref: 66 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.791107:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:0.0:1786400515.791111:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786400515.791115:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49c00, rc 0) 00000100:00100000:0.0:1786400515.791374:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+66:11604:x1873176368870912:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 667us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.791388:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 225 00000100:00100000:2.0:1786400515.795368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.795458:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368871040 00000100:00100000:1.0:1786400515.795469:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368871040 00000100:00100000:1.0:1786400515.795528:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1786400515.795538:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2362:x1873176368871040:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400515.795556:0:10836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400515.795577:0:10836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f542a expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400515.795602:0:10836:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a4f03, blocks: 0x1 00010000:00010000:1.0:1786400515.795623:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1786400515.795628:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400515.795647:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 11 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.795664:0:10836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 11 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.795696:0:10836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf600, rc 0) 00000100:00100000:1.0:1786400515.795790:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+11:2362:x1873176368871040:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 254us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400515.795798:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:3.0:1786400515.798965:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.799067:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368871296 00000100:00100000:0.0:1786400515.799077:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368871296 00000100:00100000:0.0:1786400515.799152:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 226 00000100:00100000:0.0:1786400515.799164:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b884f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+66:11604:x1873176368871296:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786400515.799496:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b884f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+66:11604:x1873176368871296:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 333us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.799504:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 226 00000100:00100000:3.0:1786400515.802052:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.802228:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368871424 00000100:00100000:0.0:1786400515.802237:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368871424 00000100:00100000:0.0:1786400515.802293:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:0.0:1786400515.802303:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+11:11604:x1873176368871424:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400515.802320:0:6623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400515.802339:0:6623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5431 expref: -99 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.802371:0:6623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 12 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.802380:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400515.802384:0:6623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400515.802389:0:6623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 12 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.802422:0:6623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 12 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.802452:0:6623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 12 pid: 10836 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.802466:0:6623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6623:1873176392975232:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400515.802691:0:6623:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7371cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400515.813523:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.813643:0:6623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6623:1873176392975232:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400515.813680:0:6623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 12 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.813703:0:6623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48000, rc 0) 00000100:00100000:0.0:1786400515.813797:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:11604:x1873176368871424:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 11494us (11752us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.813806:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:3.0:1786400515.814326:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368871552 00000100:00100000:3.0:1786400515.814333:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368871552 00010000:00010000:3.0:1786400515.814365:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 12 pid: 10836 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400515.814397:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:3.0:1786400515.814405:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:2361:x1873176368871552:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400515.814417:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400515.814438:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 12 pid: 10836 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.814450:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 12 pid: 10836 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.814472:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9667dc5/0x49554f35ff0a6044 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f542a expref: 12 pid: 10836 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.814486:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400515.814491:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400515.814511:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 11 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.814521:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 11 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.814553:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 11 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400515.814567:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e3ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5801:1873176392975360:192.168.201.23@tcp:105: 00000100:00100000:3.0:1786400515.814809:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373840b8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400515.819476:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.819566:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368871680 00000100:00100000:1.0:1786400515.819576:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368871680 00002000:00100000:1.0:1786400515.819641:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9373bfe09500 x1873176368871680/t0(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:311/0 lens 504/0 e 0 to 0 dl 1786400526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400515.819652:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373bfe09500 with x1873176368871680 ext(0->12) 00002000:00010000:1.0:1786400515.819659:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373bfe09500 00000100:00100000:1.0:1786400515.819694:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:1.0:1786400515.819704:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:2362:x1873176368871680:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1786400515.820417:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:2362:x1873176368871680:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 Request processed in 712us (949us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1786400515.820426:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00002000:00100000:1.0:1786400515.820434:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9373bfe09500 x1873176368871680/t4294967321(0) o4->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:311/0 lens 504/448 e 0 to 0 dl 1786400526 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400515.820441:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373bfe09500 with x1873176368871680 ext(0->12) 00002000:00010000:1.0:1786400515.820446:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373bfe09500 00000100:00100000:3.0:1786400515.820938:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e3ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5801:1873176392975360:192.168.201.23@tcp:105: 00010000:00010000:3.0:1786400515.820964:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400515.820999:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:2361:x1873176368871552:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 6595us (7486us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.821007:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:2.0:1786400515.823615:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.823768:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368871808 00000100:00100000:0.0:1786400515.823778:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368871808 00000100:00100000:0.0:1786400515.823838:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 227 00000100:00100000:0.0:1786400515.823849:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b79c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+66:11604:x1873176368871808:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1786400515.856652:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:2.0:1786400515.856680:0:5839:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9373b0490000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1786400515.856685:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373b05fb700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9373b0490780 00000020:00080000:2.0:1786400515.856689:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373b05fb500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9372819d8000 00000004:00080000:2.0:1786400515.856731:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1786400515.856773:0:5839:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff937390910c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1786400515.856777:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff937399e23600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9373909109c0 00000020:00080000:2.0:1786400515.856780:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff937399e23800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9373b7380800 00000001:00080000:2.0:1786400515.856796:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1786400515.856830:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1786400515.856854:0:5839:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1786400515.857441:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1786400515.857803:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1786400515.858061:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400515.858095:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392975616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786400515.858461:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400515.859076:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b79c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:11604:x1873176368871808:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 35208us (35449us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.859105:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 227 00000100:00100000:0.0:1786400515.859203:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392975488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786400515.859257:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400515.862275:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.862399:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392975616 00000100:00100000:1.0:1786400515.862409:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392975616 00000100:00100000:1.0:1786400515.862510:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392975488 00000100:00100000:1.0:1786400515.862514:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392975488 00000100:00100000:2.0:1786400515.862731:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368871936 00000100:00100000:2.0:1786400515.862736:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368871936 00000100:00100000:2.0:1786400515.862784:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786400515.862792:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392975616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786400515.862824:0:10836:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1786400515.862849:0:10836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.862867:0:10836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 13 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.862876:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786400515.862880:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400515.862884:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.862917:0:10836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 13 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.862930:0:10836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 13 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.862945:0:10836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10836:1873176392975744:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400515.863026:0:10836:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730780 going to sleep for 11 seconds 00000100:00100000:3.0:1786400515.864997:0:10836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10836:1873176392975744:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400515.865027:0:10836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400515.866088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.866662:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368872064 00000100:00100000:2.0:1786400515.866684:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368872064 00010000:00010000:2.0:1786400515.866722:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 14 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.866793:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:2.0:1786400515.866805:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+14:2361:x1873176368872064:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400515.866820:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400515.866825:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 14 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.866837:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 14 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.866861:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a5e14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5390 expref: 14 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.866878:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400515.866882:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400515.867153:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.867164:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.867201:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400515.867253:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+13:2361:x1873176368872064:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 451us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400515.867268:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00010000:00010000:3.0:1786400515.867442:0:10836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.867451:0:10836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.867466:0:10836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.867473:0:10836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.867497:0:10836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786400515.868132:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1873176392975616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5329us (9674us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1786400515.868142:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786400515.868163:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786400515.868172:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1873176392975488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786400515.868199:0:10836:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1786400515.868234:0:10836:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a7a4f02, atime: 0x6a7a4f03, ctime: 0x6a7a4f02, blocks: 0x1 00010000:00010000:3.0:1786400515.868240:0:10836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.868253:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1786400515.868257:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400515.868263:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.868276:0:10836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.868299:0:10836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.868306:0:10836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.868329:0:10836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786400515.868702:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3318:x1873176392975488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 531us (9443us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1786400515.868710:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786400515.868725:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:3.0:1786400515.868733:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:2361:x1873176368871936:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1786400515.868962:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786400515.868969:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.868979:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ec00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400515.868984:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.868992:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.869008:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.869014:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a6052 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.869033:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400515.869037:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.869044:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400515.869046:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.869054:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.869078:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.869085:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000517cacc5/0x49554f35ff0a6059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.869100:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400515.869101:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400515.869103:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786400515.869156:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b75ae680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1786400515.869163:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392975488:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1786400515.869596:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786400515.869636:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b75adc00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1786400515.869646:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392975616:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786400515.910984:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+12:2361:x1873176368871936:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 42240us (48710us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.910998:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00000001:00080000:1.0:1786400515.913802:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1786400515.913828:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:1.0:1786400515.913850:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1786400515.913862:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1786400515.914477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.914566:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368872320 00000100:00100000:1.0:1786400515.914576:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368872320 00000100:00100000:1.0:1786400515.914649:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 228 00000100:00100000:1.0:1786400515.914660:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:11604:x1873176368872320:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786400515.914719:0:8098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400515.914864:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49c00/0x49554f35ff0a603d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5423 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.914886:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:1.0:1786400515.914891:0:8098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400515.914924:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.914938:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.914946:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400515.915315:0:8098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053152ead reply state 00000000f49d170b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400515.915325:0:8098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400515.915529:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:11604:x1873176368872320:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 869us (1056us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1786400515.915579:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 228 00000100:00100000:2.0:1786400515.922381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:3.0:1786400515.922968:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.922981:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.922989:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.922995:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400515.923012:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.923021:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.923037:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:3.0:1786400515.923040:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400515.923045:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.923051:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a6060 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.923213:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368872448 00000100:00100000:0.0:1786400515.923223:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368872448 00000100:00100000:0.0:1786400515.923281:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:0.0:1786400515.923292:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368872448:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786400515.923545:0:6623:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1786400515.923549:0:6623:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1786400515 00002000:00010000:0.0:1786400515.923552:0:6623:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1786400515 00002000:00010000:0.0:1786400515.923554:0:6623:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1786400515 -> 1786400515 00002000:00010000:0.0:1786400515.923557:0:6623:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786400515.923633:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2362:x1873176368872448:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 334us (1253us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1786400515.923641:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:2.0:1786400515.926516:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400515.926596:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368872704 00000100:00100000:3.0:1786400515.926606:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368872704 00000100:00100000:3.0:1786400515.926670:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 229 00000100:00100000:3.0:1786400515.926680:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:11604:x1873176368872704:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786400515.926775:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.926791:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.926799:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.926830:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.926842:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 20 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400515.926868:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9e38000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392975872:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400515.926949:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aad80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400515.929840:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9e38000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1873176392975872:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400515.929875:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.931213:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400515.931298:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368872832 00000100:00100000:3.0:1786400515.931307:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368872832 00010000:00010000:3.0:1786400515.931350:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 21 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400515.931394:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:3.0:1786400515.931403:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:2362:x1873176368872832:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400515.931419:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400515.931426:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 21 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.931438:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 21 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.931461:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48600/0x49554f35ff0a6021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5415 expref: 21 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.931477:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:3.0:1786400515.931483:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.931492:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.931515:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.931544:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400515.931606:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:2362:x1873176368872832:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 203us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.931614:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 81 00010000:00010000:2.0:1786400515.932030:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.932038:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.932071:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.932076:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.932082:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.932086:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031c00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400515.932090:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.932109:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.932131:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:2.0:1786400515.932134:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786400515.932137:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.932144:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a6067 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.932203:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:11604:x1873176368872704:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 Request processed in 5524us (5694us total) trans 0 rc -22/-22 00000100:00100000:2.0:1786400515.932211:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 229 00000100:00100000:3.0:1786400515.938117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.938291:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368872960 00000100:00100000:0.0:1786400515.938303:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368872960 00000100:00100000:0.0:1786400515.938388:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:0.0:1786400515.938399:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368872960:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786400515.938449:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.938469:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 8 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.938478:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400515.938482:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400515.938487:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.938524:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 8 pid: 6623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.938539:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 8 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.938555:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6624:1873176392976000:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400515.938658:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b73713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400515.942019:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6624:1873176392976000:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400515.942048:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400515.945826:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.946104:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368873088 00000100:00100000:2.0:1786400515.946115:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368873088 00010000:00010000:2.0:1786400515.946169:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 9 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.946215:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:2.0:1786400515.946225:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+9:2361:x1873176368873088:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400515.946240:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400515.946263:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 9 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.946278:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 9 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.946325:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a26f68/0x49554f35ff0a604b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5431 expref: 9 pid: 6623 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.946345:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400515.946350:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400515.946356:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.946366:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.946391:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400515.946462:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368873088:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 237us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400515.946470:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 82 00010000:00010000:0.0:1786400515.946785:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.946803:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.946830:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.946838:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.946858:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.946866:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48e00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400515.946871:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.946879:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.946892:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.946898:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095db17e6/0x49554f35ff0a606e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.946973:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368872960:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 8575us (8868us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400515.946981:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:3.0:1786400515.950783:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.951527:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368873344 00000100:00100000:1.0:1786400515.951537:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368873344 00000100:00100000:1.0:1786400515.951646:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 230 00000100:00100000:1.0:1786400515.951657:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:11604:x1873176368873344:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786400515.951769:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.951788:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.951802:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.952035:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.952046:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.952056:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.952091:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.952126:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 20 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400515.952165:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f45880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392976128:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400515.952407:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400515.955371:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f45880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392976128:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400515.955403:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400515.957031:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400515.957146:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368873472 00000100:00100000:1.0:1786400515.957156:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368873472 00010000:00010000:1.0:1786400515.957205:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 21 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400515.957247:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:1.0:1786400515.957258:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:2362:x1873176368873472:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400515.957273:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400515.957280:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 21 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.957294:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 21 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.957317:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f49e00/0x49554f35ff0a602f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f541c expref: 21 pid: 5818 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.957335:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:1.0:1786400515.957341:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.957351:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.957380:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400515.957416:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400515.957473:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:2362:x1873176368873472:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 217us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400515.957480:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00010000:00010000:0.0:1786400515.957605:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.957614:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786400515.957870:0:8098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1786400515.958008:0:8098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1786400515.958050:0:8098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1786400515.958135:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7763100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8098:1873176392976256:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786400515.958184:0:8098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400515.958218:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a9926780 going to sleep for 11 seconds 00000100:00100000:1.0:1786400515.958675:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392976256 00000100:00100000:1.0:1786400515.958682:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392976256 00000100:00100000:1.0:1786400515.958731:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786400515.958759:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8098:x1873176392976256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786400515.958858:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8098:x1873176392976256:12345-0@lo:1000:mdt00_003.0 Request processed in 119us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400515.958865:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400515.960298:0:8098:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1786400515.960308:0:8098:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1786400515.960326:0:8098:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b75adc00, transno 4294967322 00000100:00100000:0.0:1786400515.960341:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7763100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8098:1873176392976256:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1786400515.961400:0:8098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1786400515.961479:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8098:1873176392976384:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786400515.961542:0:8098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400515.961586:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b73713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400515.961810:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392976384 00000100:00100000:1.0:1786400515.961818:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392976384 00000100:00100000:1.0:1786400515.961878:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786400515.961887:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8098:x1873176392976384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786400515.962074:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8098:x1873176392976384:12345-0@lo:1000:mdt00_003.0 Request processed in 188us (531us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1786400515.962082:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786400515.962298:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282437480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8098:1873176392976384:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1786400515.962331:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962342:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962351:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962357:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400515.962361:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962379:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962397:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93739128d500) 00010000:00010000:2.0:1786400515.962400:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400515.962405:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962411:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a607c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962443:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962449:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962454:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962458:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400515.962462:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962467:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962475:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:2.0:1786400515.962477:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400515.962485:0:8098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5400 expref: 23 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962507:0:8098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5400 expref: 23 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962516:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5400 expref: 23 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400515.962547:0:8098:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5400 expref: 23 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400515.962559:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392976512:192.168.201.23@tcp:105: 00000100:00100000:2.0:1786400515.962642:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b937c180 going to sleep for 11 seconds 00000100:00100000:2.0:1786400515.968409:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400515.968476:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368873600 00000100:00100000:3.0:1786400515.968486:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368873600 00000100:00100000:3.0:1786400515.968546:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:3.0:1786400515.968557:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11603:x1873176368873600:12345-192.168.201.23@tcp:49:lfs.0 00000100:00100000:3.0:1786400515.968715:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11603:x1873176368873600:12345-192.168.201.23@tcp:49:lfs.0 Request processed in 159us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.968724:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:1.0:1786400515.971225:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400515.971303:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368873856 00000100:00100000:3.0:1786400515.971314:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368873856 00000100:00100000:3.0:1786400515.971380:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 231 00000100:00100000:3.0:1786400515.971390:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11603:x1873176368873856:12345-192.168.201.23@tcp:58:lfs.0 00000040:00080000:3.0:1786400515.971836:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1786400515.971928:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+24:11603:x1873176368873856:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 538us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400515.971936:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 231 00000100:00100000:0.0:1786400515.974729:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392976512:192.168.201.23@tcp:105: 00010000:00010000:0.0:1786400515.974799:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974811:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e000/0x49554f35ff0a5fbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974866:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974882:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974894:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974907:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974913:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974919:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974924:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400515.974928:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974936:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974970:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400515.974973:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400515.974977:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974982:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48e00/0x49554f35ff0a6083 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974991:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.974997:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.975002:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.975006:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfe00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400515.975008:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.975013:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.975020:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400515.975022:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786400515.975024:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.975029:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfe00/0x49554f35ff0a6075 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400515.975266:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:11604:x1873176368873344:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 23609us (24526us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1786400515.975276:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 230 00000020:00080000:0.0:1786400515.975283:0:8098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1786400515.975643:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400515.975648:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400515.975681:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1786400515.975687:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400515.975828:0:11579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392976640:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786400515.975895:0:11579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730480 going to sleep for 11 seconds 00000100:00100000:1.0:1786400515.992280:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400515.992491:0:11579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1873176392976640:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400515.992766:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368874112 00000100:00100000:3.0:1786400515.992776:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368874112 00000100:00100000:3.0:1786400515.992833:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1786400515.992843:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390226850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:11604:x1873176368874112:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786400515.993535:0:5819:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786400515.993661:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1786400515.993709:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.993726:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.993801:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.993811:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.993818:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.993824:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400515.993837:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786400515.993925:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390226850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+25:11604:x1873176368874112:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1081us (1658us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1786400515.993933:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000020:00080000:3.0:1786400515.993938:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786400515.994193:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400515.994201:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.994209:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031e00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400515.994213:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.994222:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.994235:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9373a3445300) 00010000:00010000:0.0:1786400515.994237:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786400515.994241:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.994248:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a608a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400515.994263:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400515.994265:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400515.994267:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400515.996213:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400515.996315:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368874240 00000100:00100000:2.0:1786400515.996325:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368874240 00000100:00100000:2.0:1786400515.996386:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 232 00000100:00100000:2.0:1786400515.996397:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+25:11608:x1873176368874240:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786400515.996430:0:5816:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786400515.996531:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+25:11608:x1873176368874240:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 136us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400515.996539:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 232 00000100:00100000:2.0:1786400516.006407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400516.006701:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368874496 00000100:00100000:3.0:1786400516.006726:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368874496 00000100:00100000:3.0:1786400516.006833:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 233 00000100:00100000:3.0:1786400516.006843:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+25:11608:x1873176368874496:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400516.006869:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400516.006889:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a6091 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5438 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.006997:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a6098 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.007011:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a6098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.007022:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a6098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400516.007033:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1786400516.007185:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a6091 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5438 expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786400516.007195:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786400516.007204:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a6098 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5438 expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.007212:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400516.007215:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786400516.007219:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380031e00, rc 0) 00000100:00100000:3.0:1786400516.007284:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+27:11608:x1873176368874496:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 443us (886us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1786400516.007291:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 233 00000100:00100000:1.0:1786400516.022432:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400516.022483:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400516.022568:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368874752 00000100:00100000:3.0:1786400516.022579:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368874752 00000100:00100000:3.0:1786400516.022648:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368874880 00000100:00100000:3.0:1786400516.022652:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368874880 00000100:00100000:3.0:1786400516.022686:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 234 00000100:00100000:3.0:1786400516.022696:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+28:11608:x1873176368874752:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786400516.022803:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.022823:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.022837:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.023037:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.023045:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.023052:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.023057:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030e00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400516.023062:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.023070:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.023084:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400516.023103:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786400516.023108:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.023114:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400516.023281:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 235 00000100:00100000:1.0:1786400516.023291:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+29:11606:x1873176368874880:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400516.023303:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400516.023318:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a60ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f543f expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023366:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023375:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023384:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023398:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023405:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023412:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023686:0:8098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023703:0:8098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 30 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023711:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023776:0:8098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 30 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400516.023789:0:8098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 30 pid: 5816 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400516.023803:0:8098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a02680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392976768:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400516.024010:0:8098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b0730180 going to sleep for 11 seconds 00000100:00100000:3.0:1786400516.024439:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:11608:x1873176368874752:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 1742us (2017us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1786400516.024449:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 234 00000040:00080000:0.0:1786400516.025413:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400516.025419:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400516.025976:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1786400516.025985:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400516.027915:0:8098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a02680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8098:1873176392976768:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400516.027948:0:8098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400516.028668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400516.028805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400516.029155:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368875136 00000100:00100000:2.0:1786400516.029164:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368875136 00000100:00100000:2.0:1786400516.029213:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368875392 00000100:00100000:2.0:1786400516.029215:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368875392 00000100:00100000:2.0:1786400516.029241:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:2.0:1786400516.029248:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:11608:x1873176368875136:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786400516.029450:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11608:x1873176368875136:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 202us (785us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1786400516.029455:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:2.0:1786400516.029468:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:2.0:1786400516.029473:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:5577:x1873176368875392:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786400516.029537:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:5577:x1873176368875392:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 63us (732us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1786400516.029544:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1786400516.032152:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400516.032238:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368875520 00000100:00100000:3.0:1786400516.032247:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368875520 00010000:00010000:3.0:1786400516.032282:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 32 pid: 5816 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400516.032318:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:3.0:1786400516.032325:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:2362:x1873176368875520:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400516.032336:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400516.032341:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 32 pid: 5816 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.032352:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 32 pid: 5816 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.032372:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b8f48a00/0x49554f35ff0a5fb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f53f9 expref: 32 pid: 5816 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.032384:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400516.032397:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.032407:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.032412:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.032438:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400516.032487:0:8098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032495:0:8098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400516.032784:0:8098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1786400516.032790:0:8098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400516.032815:0:8098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032830:0:8098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032839:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032846:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032853:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032859:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400516.032864:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032883:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032894:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400516.032897:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400516.032901:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032907:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a60b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032918:0:8098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032923:0:8098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032928:0:8098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032934:0:8098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfc00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400516.032936:0:8098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032942:0:8098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032948:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9373850bf500) 00010000:00010000:0.0:1786400516.032950:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400516.032953:0:8098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.032968:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a60bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.033006:0:8098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a60ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f543f expref: 32 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400516.033019:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f543f expref: 31 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400516.033027:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+31:2362:x1873176368875520:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 700us (883us total) trans 0 rc 0/0 00010000:00010000:0.0:1786400516.033027:0:8098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400516.033029:0:8098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400516.033032:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebee00, rc 0) 00000100:00100000:3.0:1786400516.033035:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:0.0:1786400516.033063:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:11606:x1873176368874880:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 9775us (10579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400516.033070:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 235 00010000:00010000:2.0:1786400516.245522:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786400516.532948:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1786400516.532971:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1786400516.532979:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1786400516.532985:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:0.0:1786400516.768257:0:12452:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400516.768267:0:12452:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400516.768318:0:12452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1786400516.768323:0:12452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400516.981897:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400516.982263:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368875776 00000100:00100000:3.0:1786400516.982278:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368875776 00000100:00100000:3.0:1786400516.982346:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 236 00000100:00100000:3.0:1786400516.982357:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+30:11631:x1873176368875776:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400516.982390:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400516.982413:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a60c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5446 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.982519:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.982534:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.982548:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400516.982561:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1786400516.983009:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031c00/0x49554f35ff0a60c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5446 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.983026:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5446 expref: 32 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.983034:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400516.983036:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1786400516.983039:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937380030e00, rc 0) 00000100:00100000:3.0:1786400516.983140:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11631:x1873176368875776:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 783us (1249us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1786400516.983147:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 236 00000100:00100000:2.0:1786400516.995702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400516.995861:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368875904 00000100:00100000:3.0:1786400516.995872:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368875904 00000100:00100000:3.0:1786400516.995946:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 237 00000100:00100000:3.0:1786400516.995957:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11631:x1873176368875904:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:3.0:1786400516.996031:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996049:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996060:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996087:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996094:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996124:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996129:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400516.996134:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996141:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996152:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:3.0:1786400516.996155:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400516.996169:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400516.996175:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400516.996243:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:11631:x1873176368875904:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 287us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400516.996250:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 237 00000100:00100000:1.0:1786400517.100350:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400517.100487:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368876032 00000100:00100000:3.0:1786400517.100499:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368876032 00000100:00100000:3.0:1786400517.100621:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:3.0:1786400517.100632:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2360:x1873176368876032:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:3.0:1786400517.100651:0:10836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400517.100672:0:10836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133484b0/0x49554f35ff0a60e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f544d expref: -99 pid: 10836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400517.100716:0:10836:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a7a4f03, atime: 0x6a7a4f03, ctime: 0x6a7a4f03, blocks: 0xb 00010000:00010000:3.0:1786400517.100735:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1786400517.100778:0:10836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400517.100788:0:10836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133484b0/0x49554f35ff0a60e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f544d expref: 8 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400517.100809:0:10836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133484b0/0x49554f35ff0a60e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f544d expref: 8 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400517.100822:0:10836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763200, rc 0) 00000100:00100000:3.0:1786400517.100877:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2360:x1873176368876032:12345-192.168.201.23@tcp:101:cat.0 Request processed in 247us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400517.100884:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00080000:1.0:1786400517.101394:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400517.106700:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400517.106967:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368876160 00000100:00100000:1.0:1786400517.106977:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368876160 00002000:00100000:1.0:1786400517.107025:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9373c017ce00 x1873176368876160/t0(0) o3->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:313/0 lens 488/0 e 0 to 0 dl 1786400528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400517.107034:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373c017ce00 with x1873176368876160 ext(0->4095) 00002000:00010000:1.0:1786400517.107038:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373c017ce00 00000100:00100000:1.0:1786400517.107070:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:1.0:1786400517.107088:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c017ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368876160:12345-192.168.201.23@tcp:3:cat.0 00000100:00100000:1.0:1786400517.107329:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c017ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2361:x1873176368876160:12345-192.168.201.23@tcp:3:cat.0 Request processed in 239us (637us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786400517.107336:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00002000:00100000:1.0:1786400517.107343:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9373c017ce00 x1873176368876160/t0(0) o3->2e546c9b-fa03-4565-a5c8-6992a70a28db@192.168.201.23@tcp:313/0 lens 488/4536 e 0 to 0 dl 1786400528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400517.107351:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373c017ce00 with x1873176368876160 ext(0->4095) 00002000:00010000:1.0:1786400517.107354:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373c017ce00 00010000:00010000:0.0:1786400517.269194:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786400518.100332:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786400518.100344:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786400518.100381:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1786400518.100389:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786400518.291223:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400519.059591:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392976896:0@lo:400:kworker.0 00000100:00100000:2.0:1786400519.059671:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400519.059823:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392976896 00000100:00100000:0.0:1786400519.059831:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392976896 00000100:00100000:0.0:1786400519.059878:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1786400519.059886:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392976896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400519.060118:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400519.060130:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392977024:0@lo:400:kworker.0 00000100:00100000:3.0:1786400519.060161:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400519.060192:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392977024 00000100:00100000:3.0:1786400519.060196:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392977024 00000100:00100000:3.0:1786400519.060225:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1786400519.060231:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392977024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400519.060269:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392977024:12345-0@lo:400:kworker.0 Request processed in 38us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400519.060276:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1786400519.060334:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392977024:0@lo:400:kworker.0 00000100:00100000:3.0:1786400519.060370:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392977152:0@lo:400:kworker.0 00000100:00100000:3.0:1786400519.060393:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400519.060417:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392977152 00000100:00100000:3.0:1786400519.060420:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392977152 00000100:00100000:3.0:1786400519.060468:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1786400519.060474:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392977152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400519.060506:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1873176392977152:12345-0@lo:400:kworker.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400519.060512:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1786400519.060538:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1873176392977152:0@lo:400:kworker.0 00000100:00100000:1.0:1786400519.060604:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392977280:0@lo:400:kworker.0 00000100:00100000:1.0:1786400519.060641:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786400519.060700:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400519.061033:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3316:x1873176392976896:12345-0@lo:400:kworker.0 Request processed in 1146us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400519.061053:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1786400519.061146:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392977280 00000100:00100000:0.0:1786400519.061151:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392977280 00000100:00100000:0.0:1786400519.061186:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786400519.061193:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392977280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400519.061234:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392977280:12345-0@lo:400:kworker.0 Request processed in 40us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400519.061241:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1786400519.061254:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400519.061273:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392977280:0@lo:400:kworker.0 00000100:00100000:1.0:1786400519.061467:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b9113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392977536:0@lo:400:kworker.0 00000100:00100000:1.0:1786400519.061497:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400519.061714:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392977536 00000100:00100000:0.0:1786400519.061719:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392977536 00000100:00100000:0.0:1786400519.061772:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1786400519.061778:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392977536:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786400519.061844:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400519.061971:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392976896:0@lo:400:kworker.0 00000100:00100000:2.0:1786400519.061987:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392977408:0@lo:400:kworker.0 00000100:00100000:2.0:1786400519.062015:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400519.062121:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392977408 00000100:00100000:3.0:1786400519.062126:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392977408 00000100:00100000:3.0:1786400519.062165:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1786400519.062172:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392977408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400519.062208:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176392977408:12345-0@lo:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400519.062214:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1786400519.062276:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400519.062296:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937385d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392977408:0@lo:400:kworker.0 00000100:00100000:0.0:1786400519.062348:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392977536:12345-0@lo:400:kworker.0 Request processed in 569us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400519.062355:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786400519.062411:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1786400519.062417:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff937388c91c00, transno 4294967307 00000004:00080000:1.0:1786400519.062558:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1786400519.062640:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b75ae680, transno 4294967310 00000100:00100000:1.0:1786400519.062981:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b9113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392977536:0@lo:400:kworker.0 00010000:00010000:0.0:1786400519.315206:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400519.573112:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400519.573139:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400519.573214:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400519.573275:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392977664 00000100:00100000:2.0:1786400519.573284:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392977664 00000100:00100000:2.0:1786400519.573344:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786400519.573354:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392977664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400519.573391:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400519.573451:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392977664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400519.573459:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786400519.573552:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392977664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786400520.350306:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400520.487879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400520.488013:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368876416 00000100:00100000:3.0:1786400520.488025:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368876416 00000100:00100000:3.0:1786400520.488109:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 175 00000100:00100000:3.0:1786400520.488120:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:2360:x1873176368876416:12345-192.168.201.23@tcp:400:kworker.0 00000100:00080000:1.0:1786400520.488314:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400520.490433:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+32:2360:x1873176368876416:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 2305us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400520.490448:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 175 00000100:00100000:2.0:1786400520.491702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400520.494422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400520.494461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400520.494491:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400520.494544:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368876544 00000100:00100000:3.0:1786400520.494554:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368876544 00000100:00100000:3.0:1786400520.494613:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368876672 00000100:00100000:3.0:1786400520.494616:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368876672 00000100:00100000:3.0:1786400520.494641:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 102 00000100:00100000:3.0:1786400520.494651:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2359:x1873176368876544:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400520.494722:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+8:2359:x1873176368876544:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 72us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400520.494731:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 102 00000100:00100000:3.0:1786400520.494769:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:3.0:1786400520.494775:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368876672:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400520.494801:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2359:x1873176368876672:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400520.494807:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:3.0:1786400520.494827:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368876800 00000100:00100000:3.0:1786400520.494830:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368876800 00000100:00100000:3.0:1786400520.494861:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 176 00000100:00100000:3.0:1786400520.494868:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b9113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368876800:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400520.494912:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b9113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:2359:x1873176368876800:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 44us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400520.494919:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 176 00000100:00080000:3.0:1786400520.494934:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786400520.494939:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400520.494950:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400520.498680:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368876288 00000100:00100000:1.0:1786400520.498702:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368876288 00000100:00100000:1.0:1786400520.498780:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 304 00000100:00100000:1.0:1786400520.498791:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368876288:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400520.498887:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2360:x1873176368876288:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 98us (7190us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400520.500273:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 304 00000100:00100000:2.0:1786400520.595313:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:3.0:1786400520.595361:0:6763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442336620277ns, next at 443336617691ns, rc = 0 00000100:00100000:2.0:1786400520.609197:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b75c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392977792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400520.609279:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400520.611189:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392977792 00000100:00100000:0.0:1786400520.611205:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392977792 00000100:00100000:0.0:1786400520.611282:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786400520.611294:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392977792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400520.611338:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400520.611425:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392977792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400520.611434:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1786400520.611693:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b75c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392977792:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1786400521.191909:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1786400521.191927:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1786400521.197076:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:2.0:1786400521.197098:0:5839:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9373a9926240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1786400521.197103:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373b05fb100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9373a9926780 00000020:00080000:2.0:1786400521.197107:0:5839:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9373b05fb200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9373b77be000 00000020:00080000:2.0:1786400521.197134:0:5839:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1786400521.197145:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000004:00080000:2.0:1786400521.197155:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:2.0:1786400521.197177:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:0.0:1786400521.197346:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400521.197373:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392977920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786400521.197443:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400521.197514:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392977920 00000100:00100000:0.0:1786400521.197523:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392977920 00000100:00100000:0.0:1786400521.197584:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786400521.197593:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392977920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786400521.197832:0:6624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1786400521.197837:0:6624:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1786400515 -> 1786400515 00002000:00010000:0.0:1786400521.197839:0:6624:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1786400515 -> 1786400515 00002000:00010000:0.0:1786400521.197842:0:6624:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1786400515 -> 1786400515 00002000:00010000:0.0:1786400521.197844:0:6624:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1786400521.197884:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392977920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (441us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1786400521.197892:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786400521.197928:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1786400521.197933:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1786400521.197954:0:3315:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9373b7761500 x1873176392977920/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786400537 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786400521.197966:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b7761500/2, rc 0, transno 4294967325 00000100:00100000:0.0:1786400521.197970:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392977920:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1786400521.198116:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1786400521.201300:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1786400521.201553:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1786400521.367813:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400522.389998:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400522.620672:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400522.620793:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368876928 00000100:00100000:0.0:1786400522.620803:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368876928 00000100:00100000:0.0:1786400522.620883:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 238 00000100:00100000:0.0:1786400522.620894:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:11284:x1873176368876928:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786400522.621034:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:11284:x1873176368876928:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 142us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400522.621042:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 238 00000100:00080000:3.0:1786400522.621170:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400522.625528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400522.625671:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368877184 00000100:00100000:3.0:1786400522.625682:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368877184 00000100:00100000:3.0:1786400522.625770:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:3.0:1786400522.625780:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:11284:x1873176368877184:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786400522.626304:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:11284:x1873176368877184:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 523us (793us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1786400522.626313:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:2.0:1786400522.956932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400522.957075:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368877312 00000100:00100000:3.0:1786400522.957086:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368877312 00000100:00100000:3.0:1786400522.957176:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 239 00000100:00100000:3.0:1786400522.957187:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+5:12083:x1873176368877312:12345-192.168.201.23@tcp:101:lsof.0 00010000:00010000:3.0:1786400522.957208:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400522.957230:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5454 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400522.957293:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a60f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400522.957307:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a60f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400522.957320:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a60f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400522.957545:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786400522.957549:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400522.957620:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a60f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400522.957643:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763800/0x49554f35ff0a60ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5454 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400522.957658:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a60f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5454 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400522.957666:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:3.0:1786400522.957669:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400522.957672:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762600, rc 0) 00000100:00100000:3.0:1786400522.957730:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:12083:x1873176368877312:12345-192.168.201.23@tcp:101:lsof.0 Request processed in 546us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400522.957791:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 239 00000100:00080000:0.0:1786400522.957863:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786400523.411617:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400524.179780:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392978048:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.179857:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400524.179933:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392978560:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.179961:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400524.179995:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786400524.180002:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392978176:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.180027:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400524.180054:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392978688:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.180079:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400524.180106:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392978432:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.180128:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400524.180143:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400524.180148:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392978304:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.180168:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400524.180432:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392978048 00000100:00100000:1.0:1786400524.180441:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392978048 00000100:00100000:1.0:1786400524.180493:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1786400524.180503:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392978048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400524.180556:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392978048:12345-0@lo:400:kworker.0 Request processed in 55us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400524.180564:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1786400524.180596:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392978560 00000100:00100000:1.0:1786400524.180600:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392978560 00000100:00100000:1.0:1786400524.180640:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392978176 00000100:00100000:1.0:1786400524.180643:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392978176 00000100:00100000:1.0:1786400524.180654:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392978304 00000100:00100000:1.0:1786400524.180656:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392978304 00000100:00100000:1.0:1786400524.180669:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1786400524.180674:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b75adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392978560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400524.180702:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b75adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392978560:12345-0@lo:400:kworker.0 Request processed in 27us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400524.180719:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1786400524.180731:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1786400524.180774:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392978176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400524.180804:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392978176:12345-0@lo:400:kworker.0 Request processed in 68us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400524.180810:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1786400524.180821:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786400524.180827:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392978304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400524.180854:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176392978304:12345-0@lo:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400524.180860:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1786400524.181077:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176392978304:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.181105:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392978176:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.181113:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392978048:0@lo:400:kworker.0 00000100:00100000:2.0:1786400524.181121:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392978560:0@lo:400:kworker.0 00000100:00080000:0.0:1786400524.181213:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400524.181343:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392978688 00000100:00100000:3.0:1786400524.181349:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392978688 00000100:00100000:3.0:1786400524.181411:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392978432 00000100:00100000:3.0:1786400524.181414:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392978432 00000100:00100000:3.0:1786400524.181434:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786400524.181442:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b798bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392978688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400524.181489:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b798bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392978688:12345-0@lo:400:kworker.0 Request processed in 49us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400524.181496:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786400524.181509:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786400524.181523:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373afe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392978432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400524.181564:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373afe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1873176392978432:12345-0@lo:400:kworker.0 Request processed in 42us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400524.181569:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786400524.181604:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392978432:0@lo:400:kworker.0 00000100:00080000:0.0:1786400524.181720:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786400524.181723:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400524.181862:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392978688:0@lo:400:kworker.0 00010000:00010000:0.0:1786400524.437786:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400524.691778:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400524.691802:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373987f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392978816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400524.691869:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400524.692141:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392978816 00000100:00100000:2.0:1786400524.692149:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392978816 00000100:00100000:2.0:1786400524.692216:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1786400524.692227:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392978816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400524.692266:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400524.692321:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392978816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400524.692340:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786400524.692626:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373987f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392978816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400525.459214:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400525.614671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400525.614721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400525.614786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400525.614821:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400525.614848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400525.614876:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368877952 00000100:00100000:1.0:1786400525.614885:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368877952 00000100:00100000:1.0:1786400525.614936:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368877568 00000100:00100000:1.0:1786400525.614939:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368877568 00000100:00100000:1.0:1786400525.614973:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 180 00000100:00100000:1.0:1786400525.614983:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2362:x1873176368877952:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400525.615070:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2362:x1873176368877952:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400525.615078:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 180 00000100:00100000:1.0:1786400525.615197:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 181 00000100:00100000:1.0:1786400525.615204:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:2362:x1873176368877568:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400525.615422:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:2362:x1873176368877568:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 217us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400525.615430:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 181 00000100:00080000:1.0:1786400525.615450:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400525.615715:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368877440 00000100:00100000:2.0:1786400525.615721:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368877440 00000100:00100000:3.0:1786400525.617352:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368877696 00000100:00100000:3.0:1786400525.617372:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368877696 00000100:00100000:3.0:1786400525.617436:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368877824 00000100:00100000:3.0:1786400525.617440:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368877824 00000100:00100000:3.0:1786400525.617477:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 106 00000100:00100000:3.0:1786400525.617487:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368877696:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400525.617554:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2362:x1873176368877696:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 69us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400525.617562:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 106 00000100:00100000:3.0:1786400525.617578:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 107 00000100:00100000:3.0:1786400525.617585:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368877824:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400525.617609:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2362:x1873176368877824:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400525.617616:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 107 00000100:00080000:3.0:1786400525.617641:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400525.617645:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400525.633295:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 306 00000100:00100000:2.0:1786400525.633323:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368877440:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400525.633442:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368877440:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 133us (18780us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400525.633451:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 306 00000100:00100000:1.0:1786400525.716205:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400525.716233:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392978944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400525.716308:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400525.716438:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392978944 00000100:00100000:2.0:1786400525.716446:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392978944 00000100:00100000:2.0:1786400525.716506:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1786400525.716516:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392978944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400525.716564:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400525.716628:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1873176392978944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400525.716636:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1786400525.716805:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392978944:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1786400526.293032:0:5839:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1786400526.293066:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1786400526.293093:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1786400526.293103:0:5850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1786400526.328077:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:0.0:1786400526.482989:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400527.507256:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786400528.164361:0:12656:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:22:06 (1786400526) 00000040:00080000:0.0:1786400528.340014:0:11579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400528.340025:0:11579:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400528.340695:0:11579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1786400528.340704:0:11579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786400528.537046:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400529.299050:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392979328:0@lo:400:kworker.0 00000100:00100000:1.0:1786400529.299122:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400529.299185:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400529.299192:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392979456:0@lo:400:kworker.0 00000100:00100000:1.0:1786400529.299219:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400529.299265:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392979328 00000100:00100000:1.0:1786400529.299273:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392979328 00000100:00100000:1.0:1786400529.299338:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1786400529.299348:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392979328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400529.299405:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392979328:12345-0@lo:400:kworker.0 Request processed in 59us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400529.299413:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1786400529.299441:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392979456 00000100:00100000:1.0:1786400529.299444:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392979456 00000100:00100000:1.0:1786400529.299475:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786400529.299482:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392979456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400529.299513:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392979456:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400529.299534:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1786400529.299551:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400529.299555:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400529.299584:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1786400529.299589:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b7761500, transno 4294967325 00000100:00100000:1.0:1786400529.299600:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392979456:0@lo:400:kworker.0 00000100:00100000:1.0:1786400529.299610:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392979328:0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.300379:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392979072:0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.300424:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400529.300469:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392979584:0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.300499:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400529.300520:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786400529.300526:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392979200:0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.300579:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400529.300605:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392979712:0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.300628:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400529.300667:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392979584 00000100:00100000:0.0:1786400529.300673:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392979584 00000100:00100000:0.0:1786400529.300713:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392979200 00000100:00100000:0.0:1786400529.300716:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392979200 00000100:00100000:0.0:1786400529.300729:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1786400529.300734:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392979584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.300801:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392979584:12345-0@lo:400:kworker.0 Request processed in 66us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400529.300808:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1786400529.300822:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1786400529.300828:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392979200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.300854:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392979200:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400529.300860:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786400529.301578:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392979072 00000100:00100000:2.0:1786400529.301586:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392979072 00000100:00100000:2.0:1786400529.301626:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1786400529.301635:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392979072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400529.301679:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392979072:12345-0@lo:400:kworker.0 Request processed in 46us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400529.301698:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1786400529.303389:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392979712 00000100:00100000:0.0:1786400529.303399:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392979712 00000100:00100000:0.0:1786400529.303460:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786400529.303470:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392979712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.303546:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176392979712:12345-0@lo:400:kworker.0 Request processed in 78us (2915us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400529.303553:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1786400529.303573:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400529.303578:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400529.303695:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392979200:0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.303720:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392979712:0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.303730:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392979072:0@lo:400:kworker.0 00000100:00100000:0.0:1786400529.303761:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392979584:0@lo:400:kworker.0 00010000:00010000:0.0:1786400529.557206:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400529.818071:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373984c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392979840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400529.818155:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400529.818339:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392979840 00000100:00100000:3.0:1786400529.818350:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392979840 00000100:00100000:3.0:1786400529.818443:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1786400529.818453:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392979840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400529.818497:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400529.818548:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392979840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400529.818557:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1786400529.818615:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373984c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392979840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786400530.585674:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400530.723106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400530.723156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400530.723189:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368878336 00000100:00100000:0.0:1786400530.723200:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368878336 00000100:00100000:0.0:1786400530.723266:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00100000:0.0:1786400530.723278:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368878336:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400530.723370:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2361:x1873176368878336:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400530.723378:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00080000:0.0:1786400530.723403:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400530.725074:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368878080 00000100:00100000:0.0:1786400530.725086:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368878080 00000100:00100000:0.0:1786400530.725141:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 308 00000100:00100000:0.0:1786400530.725150:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368878080:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400530.725216:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2361:x1873176368878080:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 67us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400530.725223:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 308 00000100:00100000:3.0:1786400530.731361:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400530.731433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400530.731464:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400530.734404:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368878592 00000100:00100000:1.0:1786400530.734420:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368878592 00000100:00100000:1.0:1786400530.734496:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368878208 00000100:00100000:1.0:1786400530.734500:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368878208 00000100:00100000:1.0:1786400530.734529:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 185 00000100:00100000:1.0:1786400530.734541:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373984c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2361:x1873176368878592:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400530.734627:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373984c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2361:x1873176368878592:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 89us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400530.734634:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 185 00000100:00100000:1.0:1786400530.734652:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 186 00000100:00100000:1.0:1786400530.734658:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:2361:x1873176368878208:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400530.734681:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:2361:x1873176368878208:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 24us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400530.734687:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 186 00000100:00100000:1.0:1786400530.734710:0:11904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368878464 00000100:00100000:1.0:1786400530.734715:0:11904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368878464 00000100:00100000:1.0:1786400530.734763:0:11904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 111 00000100:00100000:1.0:1786400530.734771:0:11904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368878464:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400530.734808:0:11904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2361:x1873176368878464:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 38us (3343us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400530.734815:0:11904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 111 00000100:00080000:2.0:1786400530.737502:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400530.737512:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400530.838112:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392979968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400530.838190:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400530.838273:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392979968 00000100:00100000:3.0:1786400530.838281:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392979968 00000100:00100000:3.0:1786400530.838326:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1786400530.838334:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392979968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400530.838436:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400530.838481:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392979968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400530.838488:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1786400530.838533:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392979968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400531.603885:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400532.626919:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400533.063369:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400533.063468:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368878848 00000100:00100000:2.0:1786400533.063478:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368878848 00000100:00100000:2.0:1786400533.063549:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:2.0:1786400533.063560:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+19:12305:x1873176368878848:12345-192.168.201.23@tcp:35:umount.0 00000100:00100000:2.0:1786400533.064276:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:12305:x1873176368878848:12345-192.168.201.23@tcp:35:umount.0 Request processed in 716us (915us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1786400533.064287:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00080000:0.0:1786400533.064447:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400533.069527:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400533.069630:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368879104 00000100:00100000:2.0:1786400533.069641:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368879104 00000100:00100000:2.0:1786400533.069703:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:2.0:1786400533.069713:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+20:12305:x1873176368879104:12345-192.168.201.23@tcp:35:umount.0 00000100:00100000:2.0:1786400533.070567:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:12305:x1873176368879104:12345-192.168.201.23@tcp:35:umount.0 Request processed in 851us (1044us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1786400533.070577:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:1.0:1786400533.074846:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400533.074932:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368879360 00000100:00100000:3.0:1786400533.074943:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368879360 00000100:00100000:3.0:1786400533.075012:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:3.0:1786400533.075023:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937390224050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+21:12305:x1873176368879360:12345-192.168.201.23@tcp:35:umount.0 00000100:00100000:3.0:1786400533.075696:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937390224050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:12305:x1873176368879360:12345-192.168.201.23@tcp:35:umount.0 Request processed in 672us (874us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1786400533.075705:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:0.0:1786400533.078550:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400533.078639:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368879616 00000100:00100000:2.0:1786400533.078648:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368879616 00000100:00100000:2.0:1786400533.078693:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:2.0:1786400533.078701:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+22:12305:x1873176368879616:12345-192.168.201.23@tcp:35:umount.0 00000100:00100000:2.0:1786400533.079176:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:12305:x1873176368879616:12345-192.168.201.23@tcp:35:umount.0 Request processed in 474us (632us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1786400533.079184:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:1.0:1786400533.090505:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400533.090543:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400533.090585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400533.090807:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400533.090854:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368880128 00000100:00100000:1.0:1786400533.090864:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368880128 00000100:00100000:1.0:1786400533.090926:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:1.0:1786400533.090936:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+5:2358:x1873176368880128:12345-192.168.201.23@tcp:9:umount.0 00000020:00000080:1.0:1786400533.090979:0:10836:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a5443 00000100:00080000:1.0:1786400533.090987:0:10836:0:(import.c:65:import_set_state_nolock()) ffff937399734000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786400533.091028:0:10836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1786400533.091332:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+2:2358:x1873176368880128:12345-192.168.201.23@tcp:9:umount.0 Request processed in 396us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400533.091341:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00080000:1.0:1786400533.091392:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786400533.091407:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400533.092584:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368879744 00000100:00100000:0.0:1786400533.092598:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368879744 00000100:00100000:0.0:1786400533.092647:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368880000 00000100:00100000:0.0:1786400533.092650:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368880000 00000100:00100000:0.0:1786400533.092662:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368879872 00000100:00100000:0.0:1786400533.092664:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368879872 00000100:00100000:0.0:1786400533.092680:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1786400533.092689:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+15:2362:x1873176368879744:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400533.092704:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400533.092722:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380031000/0x49554f35ff0a516b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fdf expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.093518:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400533.093597:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+14:2362:x1873176368879744:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 905us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400533.093607:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1786400533.093633:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1786400533.093641:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+13:2362:x1873176368880000:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400533.093652:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400533.093663:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399762200/0x49554f35ff0a5355 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50aa expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.093675:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400533.093694:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:2362:x1873176368880000:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 55us (3151us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400533.093700:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1786400533.093710:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:0.0:1786400533.093716:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:2362:x1873176368879872:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400533.093734:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400533.093758:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f4400/0x49554f35ff0a50d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fa7 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.093767:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400533.093786:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2362:x1873176368879872:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 69us (3200us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400533.093792:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:1.0:1786400533.099950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400533.100601:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368880512 00000100:00100000:0.0:1786400533.100614:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368880512 00000100:00100000:0.0:1786400533.100762:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:0.0:1786400533.100774:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+7:2358:x1873176368880512:12345-192.168.201.23@tcp:9:umount.0 00000020:00000080:0.0:1786400533.100805:0:6624:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a56a4 00000020:00010000:0.0:1786400533.100813:0:6624:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9373b890f800: total 0 00000100:00080000:0.0:1786400533.100817:0:6624:0:(import.c:65:import_set_state_nolock()) ffff937391238000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786400533.100881:0:6624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:3.0:1786400533.102378:0:5804:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9373b890f800: total 0 00010000:00010000:3.0:1786400533.102426:0:5804:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9373b890f800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1786400533.102484:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133484b0/0x49554f35ff0a60e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f544d expref: 5 pid: 10836 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400533.102518:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a5a47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f527f expref: 4 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400533.102533:0:5804:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9373b890f800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1786400533.102543:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400533.102546:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400533.102547:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400533.102681:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e546c9b-fa03-4565-a5c8-6992a70a28db+2:2358:x1873176368880512:12345-192.168.201.23@tcp:9:umount.0 Request processed in 1908us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400533.102692:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00080000:1.0:1786400533.103617:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400533.113467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400533.113577:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368881536 00000100:00100000:1.0:1786400533.113589:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368881536 00000100:00100000:1.0:1786400533.113655:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 240 00000100:00100000:1.0:1786400533.113666:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+23:2358:x1873176368881536:12345-192.168.201.23@tcp:39:umount.0 00000020:00000080:1.0:1786400533.113712:0:8098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a50df 00000020:00010000:1.0:1786400533.113731:0:8098:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9373b9c2d000: total 0 00000100:00080000:1.0:1786400533.113735:0:8098:0:(import.c:65:import_set_state_nolock()) ffff9373bf3f3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786400533.113800:0:8098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1786400533.114561:0:5803:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9373b9c2d000: total 0 00010000:00010000:0.0:1786400533.114566:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400533.114610:0:5803:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9373b9c2d000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1786400533.114645:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400533.114648:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786400533.114658:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030e00/0x49554f35ff0a60d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5446 expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.114693:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400533.114695:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400533.114701:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763c00/0x49554f35ff0a5a08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f526a expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.114711:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400533.114714:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786400533.114718:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763e00/0x49554f35ff0a5a32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5278 expref: 22 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.114730:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400533.114732:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400533.114736:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031600/0x49554f35ff0a5da4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5374 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.114800:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400533.114803:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400533.114807:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763600/0x49554f35ff0a5706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f51a6 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.114830:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93739128de00) 00010000:00010000:0.0:1786400533.114832:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400533.114837:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030a00/0x49554f35ff0a53a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50b8 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.115039:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff937386801700) 00010000:00010000:0.0:1786400533.115042:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786400533.115053:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fe00/0x49554f35ff0a5ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f52a2 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.115070:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff937386801800) 00010000:00010000:0.0:1786400533.115072:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400533.115074:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf800/0x49554f35ff0a5928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5232 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.115088:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff937386801000) 00010000:00010000:0.0:1786400533.115089:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786400533.115093:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ea00/0x49554f35ff0a5419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50d4 expref: 14 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.115105:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400533.115107:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400533.115110:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380030600/0x49554f35ff0a5fc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5400 expref: 13 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.115120:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400533.115123:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400533.115126:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebee00/0x49554f35ff0a60c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f543f expref: 12 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.115137:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9373a3445900) 00010000:00010000:0.0:1786400533.115139:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786400533.115143:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937380031e00/0x49554f35ff0a6098 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5438 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400533.115501:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e546c9b-fa03-4565-a5c8-6992a70a28db+10:2358:x1873176368881536:12345-192.168.201.23@tcp:39:umount.0 Request processed in 1836us (2042us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1786400533.115512:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 240 00010000:00010000:0.0:1786400533.115604:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:0.0:1786400533.115613:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400533.115619:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763000/0x49554f35ff0a5aa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f529b expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.115635:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9373a3445800) 00010000:00010000:0.0:1786400533.115638:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400533.115641:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399763400/0x49554f35ff0a53c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50bf expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400533.115654:0:5803:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9373b9c2d000, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1786400533.115670:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400533.115672:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400533.115674:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400533.650953:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400534.419292:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392980224:0@lo:400:kworker.0 00000100:00100000:2.0:1786400534.419393:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400534.419461:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392980736:0@lo:400:kworker.0 00000100:00100000:2.0:1786400534.419733:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400534.419793:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786400534.419810:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392980096:0@lo:400:kworker.0 00000100:00100000:2.0:1786400534.419842:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400534.420022:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392980352:0@lo:400:kworker.0 00000100:00100000:3.0:1786400534.420054:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400534.420075:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400534.420081:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392980480:0@lo:400:kworker.0 00000100:00100000:3.0:1786400534.420115:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400534.420163:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392980096 00000100:00100000:3.0:1786400534.420171:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392980096 00000100:00100000:3.0:1786400534.420215:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1786400534.420225:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392980096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400534.420272:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3318:x1873176392980096:12345-0@lo:400:kworker.0 Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400534.420279:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1786400534.420393:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392980096:0@lo:400:kworker.0 00000100:00100000:2.0:1786400534.420400:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392980608:0@lo:400:kworker.0 00000100:00100000:2.0:1786400534.420425:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400534.420646:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392980224 00000100:00100000:1.0:1786400534.420651:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392980224 00000100:00100000:1.0:1786400534.420689:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392980352 00000100:00100000:1.0:1786400534.420693:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392980352 00000100:00100000:1.0:1786400534.420725:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392980608 00000100:00100000:1.0:1786400534.420729:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392980608 00000100:00100000:1.0:1786400534.420765:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1786400534.420772:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392980224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400534.421055:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1786400534.421064:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392980352:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786400534.421118:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400534.421140:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392980736 00000100:00100000:3.0:1786400534.421144:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392980736 00000100:00100000:3.0:1786400534.421189:0:10836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392980480 00000100:00100000:3.0:1786400534.421192:0:10836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392980480 00000100:00100000:3.0:1786400534.421215:0:10836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1786400534.421223:0:10836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373987f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392980736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400534.421377:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1786400534.421385:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1786400534.421567:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176392980224:0@lo:400:kworker.0 00000100:00100000:2.0:1786400534.421608:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786400534.421616:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392980608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400534.428316:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392980352:12345-0@lo:400:kworker.0 Request processed in 7233us (8240us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400534.428333:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1786400534.428399:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1786400534.428414:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392980480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400534.428473:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392980480:12345-0@lo:400:kworker.0 Request processed in 64us (8356us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400534.428494:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1786400534.428635:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786400534.428641:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400534.428858:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392980480:0@lo:400:kworker.0 00000100:00100000:0.0:1786400534.428871:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392980352:0@lo:400:kworker.0 00000100:00100000:3.0:1786400534.430874:0:10836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392980736:12345-0@lo:400:kworker.0 Request processed in 9645us (11133us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400534.430886:0:10836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1786400534.433065:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392980736:0@lo:400:kworker.0 00000100:00100000:1.0:1786400534.435901:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373987f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176392980224:12345-0@lo:400:kworker.0 Request processed in 15120us (16499us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400534.435925:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1786400534.442290:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392980608:12345-0@lo:400:kworker.0 Request processed in 20665us (21853us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400534.442425:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392980608:0@lo:400:kworker.0 00000100:00100000:2.0:1786400534.442502:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00010000:0.0:1786400534.676810:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400534.931660:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400534.931683:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392980864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400534.931800:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400534.932367:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392980864 00000100:00100000:2.0:1786400534.932376:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392980864 00000100:00100000:2.0:1786400534.932445:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1786400534.932455:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392980864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400534.932492:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400534.932552:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392980864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400534.932560:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1786400534.932666:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392980864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400535.347026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400535.347072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400535.347114:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400535.347275:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368881664 00000100:00100000:0.0:1786400535.347286:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368881664 00000100:00100000:0.0:1786400535.347345:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368881920 00000100:00100000:0.0:1786400535.347348:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368881920 00000100:00100000:0.0:1786400535.347360:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368881792 00000100:00100000:0.0:1786400535.347362:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368881792 00000100:00100000:0.0:1786400535.347376:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:0.0:1786400535.347386:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+12:2360:x1873176368881664:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400535.347403:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400535.347425:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380030c00/0x49554f35ff0a51b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4ff4 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400535.347442:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400535.347495:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+11:2360:x1873176368881664:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 110us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400535.347502:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:0.0:1786400535.347519:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:0.0:1786400535.347525:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+10:2361:x1873176368881920:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400535.347534:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400535.347543:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebe800/0x49554f35ff0a534e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f50a3 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400535.347572:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400535.347589:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+9:2361:x1873176368881920:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 65us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400535.347595:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:0.0:1786400535.347606:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1786400535.347611:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+8:2360:x1873176368881792:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400535.347635:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400535.347643:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebe600/0x49554f35ff0a51b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f501e expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400535.347650:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400535.347665:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+7:2360:x1873176368881792:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 54us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400535.347670:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1786400535.363497:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400535.364178:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368882176 00000100:00100000:1.0:1786400535.364189:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368882176 00000100:00100000:1.0:1786400535.364298:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 241 00000100:00100000:1.0:1786400535.364306:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+6:2358:x1873176368882176:12345-192.168.201.23@tcp:39:umount.0 00000020:00000080:1.0:1786400535.364341:0:5818:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a51c6 00000020:00010000:1.0:1786400535.364349:0:5818:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9373bf3f5000: total 0 00000100:00080000:1.0:1786400535.364365:0:5818:0:(import.c:65:import_set_state_nolock()) ffff9373bf3f7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786400535.364395:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1786400535.364610:0:5804:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9373bf3f5000: total 0 00010000:00010000:3.0:1786400535.364666:0:5804:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9373bf3f5000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1786400535.364700:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373a3445700) 00010000:00010000:3.0:1786400535.364704:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400535.364712:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937399762600/0x49554f35ff0a60f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5454 expref: 5 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400535.364768:0:5804:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9373bf3f5000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1786400535.364792:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400535.364794:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400535.364796:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400535.365767:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c60e7c-6fb5-4b8c-8c57-d94093690eb5+3:2358:x1873176368882176:12345-192.168.201.23@tcp:39:umount.0 Request processed in 1456us (2286us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1786400535.365777:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 241 00000100:00080000:0.0:1786400535.371048:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400535.388258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400535.389260:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368882432 00000100:00100000:0.0:1786400535.389271:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368882432 00000100:00100000:0.0:1786400535.389345:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 310 00000100:00100000:0.0:1786400535.389356:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+7:2358:x1873176368882432:12345-192.168.201.23@tcp:251:umount.0 00000020:00000080:0.0:1786400535.389406:0:5811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a50bc 00000020:00010000:0.0:1786400535.389413:0:5811:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9373b04b0800: total 0 00000100:00080000:0.0:1786400535.389417:0:5811:0:(import.c:65:import_set_state_nolock()) ffff9373b04b1800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1786400535.389568:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937386fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e6bd34d-d4c5-467c-8069-f8c8a16a72d9+3:2358:x1873176368882432:12345-192.168.201.23@tcp:251:umount.0 Request processed in 213us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400535.389577:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 310 00000020:00010000:1.0:1786400535.398056:0:5803:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9373b04b0800: total 0 00010000:00010000:1.0:1786400535.398067:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400535.398124:0:5803:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9373b04b0800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1786400535.398161:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399762800/0x49554f35ff0a5172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f4fe6 expref: 2 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400535.398179:0:5803:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9373b04b0800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1786400535.398189:0:5803:0:(genops.c:906:class_export_put()) final put ffff9373b04b0800/6e6bd34d-d4c5-467c-8069-f8c8a16a72d9 00010000:00010000:1.0:1786400535.398211:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400535.398213:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400535.398215:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786400535.398418:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b04b0800/6e6bd34d-d4c5-467c-8069-f8c8a16a72d9 for MGS 00000020:00000080:3.0:1786400535.398464:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373b04b1800 for MGS 00010000:00010000:3.0:1786400535.702022:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400535.955573:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392980992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400535.955649:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400535.955731:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392980992 00000100:00100000:1.0:1786400535.955757:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392980992 00000100:00100000:1.0:1786400535.955824:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786400535.955834:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392980992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400535.955870:0:6625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400535.955927:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392980992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400535.955936:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786400535.955987:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392980992:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1786400536.531229:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00000001:00080000:0.0:1786400536.531249:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1786400536.531255:0:5839:0:(genops.c:906:class_export_put()) final put ffff9373bf3f5000/70c60e7c-6fb5-4b8c-8c57-d94093690eb5 00000001:00100000:0.0:1786400536.531281:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000001:00080000:0.0:1786400536.531286:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1786400536.531304:0:5839:0:(genops.c:906:class_export_put()) final put ffff9373b9c2d000/2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:0.0:1786400536.531320:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf3f5000/70c60e7c-6fb5-4b8c-8c57-d94093690eb5 for lustre-MDT0000 00000020:00000080:0.0:1786400536.531366:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b9c2d000/2e546c9b-fa03-4565-a5c8-6992a70a28db for lustre-MDT0000 00000020:00000080:0.0:1786400536.531394:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373bf3f7000 for lustre-MDT0000 00000020:00000080:0.0:1786400536.531400:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373bf3f3800 for lustre-MDT0000 00000001:00100000:0.0:1786400536.574398:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:0.0:1786400536.574408:0:6647:0:(genops.c:906:class_export_put()) final put ffff9373b890f800/2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:2.0:1786400536.574920:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b890f800/2e546c9b-fa03-4565-a5c8-6992a70a28db for lustre-OST0000 00000020:00000080:2.0:1786400536.574972:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff937391238000 for lustre-OST0000 00010000:00010000:2.0:1786400536.724900:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786400537.070344:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:3.0:1786400537.070355:0:7536:0:(genops.c:906:class_export_put()) final put ffff937399733800/2e546c9b-fa03-4565-a5c8-6992a70a28db 00000020:00000080:0.0:1786400537.070422:0:10440:0:(genops.c:865:class_export_destroy()) destroying export ffff937399733800/2e546c9b-fa03-4565-a5c8-6992a70a28db for lustre-OST0001 00000020:00000080:0.0:1786400537.070477:0:10440:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff937399734000 for lustre-OST0001 00000020:01000004:0.0:1786400537.502023:0:12857:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1786400537.539893:0:12857:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1786400537.540119:0:12857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.540135:0:12857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.540144:0:12857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.540151:0:12857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.540221:0:12857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786400537.540237:0:12857:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1786400537.540264:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786400537.540269:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1786400537.540274:0:12857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1786400537.540296:0:12857:0:(import.c:65:import_set_state_nolock()) ffff9373b6efa000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1786400537.540512:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400537.540521:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.540529:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fd400 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400537.540532:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.540541:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400537.540550:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400537.540556:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400537.540559:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1786400537.540562:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1786400537.540588:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.540611:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400537.540636:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.540642:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c21fd400/0x49554f35ff0a5141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a5148 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.540656:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.540658:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.540661:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400537.540913:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392981248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400537.540982:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400537.541358:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392981120:0@lo:39:umount.0 00000100:00100000:1.0:1786400537.541402:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400537.541519:0:12769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392981120 00000100:00100000:0.0:1786400537.541527:0:12769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392981120 00000100:00100000:0.0:1786400537.541576:0:12769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1786400537.541585:0:12769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873176392981120:12345-0@lo:39:umount.0 00000020:00000080:0.0:1786400537.541610:0:12769:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4ecb 00000100:00080000:0.0:1786400537.541617:0:12769:0:(import.c:65:import_set_state_nolock()) ffff9373b6ebf000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1786400537.541683:0:12769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3314:x1873176392981120:12345-0@lo:39:umount.0 Request processed in 97us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400537.541691:0:12769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1786400537.541696:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392981248 00000020:00000080:0.0:1786400537.541701:0:12769:0:(genops.c:906:class_export_put()) final put ffff9373b6ebd000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1786400537.541703:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392981248 00000100:00100000:2.0:1786400537.541776:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1786400537.541785:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b6efa000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1786400537.541786:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+19:3317:x1873176392981248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400537.541800:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400537.541819:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380031a00/0x49554f35ff0a5148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a5141 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400537.541833:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400537.541868:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e769e6f-cf99-4814-98f1-5b8d54010374+18:3317:x1873176392981248:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400537.541875:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:2.0:1786400537.541894:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b6ebd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1786400537.541941:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373b6ebf000 for lustre-MDT0000 00000100:00100000:2.0:1786400537.541969:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392981248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400537.542296:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392981120:0@lo:39:umount.0 00000100:00080000:0.0:1786400537.542502:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786400537.542507:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1786400537.542512:0:12857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1786400537.543121:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400537.544548:0:12857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.544566:0:12857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.544592:0:12857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.545068:0:12857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.545133:0:12857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786400537.545141:0:12857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.545149:0:12857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.545155:0:12857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.545161:0:12857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545229:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786400537.545237:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545244:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4200 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400537.545248:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545257:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400537.545265:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400537.545271:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400537.545273:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1786400537.545306:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545339:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400537.545375:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545382:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f4200/0x49554f35ff0a514f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a5156 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545399:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400537.545402:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545408:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c21fd600 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400537.545411:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545417:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400537.545423:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400537.545427:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400537.545429:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1786400537.545440:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545445:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400537.545460:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.545477:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.545479:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.545481:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400537.545492:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400537.545511:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392981504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400537.545568:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400537.545635:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392981504 00000100:00100000:3.0:1786400537.545642:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392981504 00000100:00100000:3.0:1786400537.546019:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400537.546028:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+18:3316:x1873176392981504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400537.546041:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400537.546056:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937380030000/0x49554f35ff0a507d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a5076 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.546073:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400537.546102:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400537.546117:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392981376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400537.546125:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3316:x1873176392981504:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400537.546135:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786400537.546157:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400537.546177:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392981504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786400537.546192:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392981376 00000100:00100000:2.0:1786400537.546198:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392981376 00000100:00100000:2.0:1786400537.546242:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786400537.546251:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+17:3317:x1873176392981376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400537.546260:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400537.546271:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399762400/0x49554f35ff0a5156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a514f expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400537.546291:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400537.546318:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3317:x1873176392981376:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400537.546325:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786400537.546350:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e769e6f-cf99-4814-98f1-5b8d54010374:3317:1873176392981376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400537.547273:0:12857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786400537.547282:0:12857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c21fd600/0x49554f35ff0a5076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a507d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400537.547300:0:12857:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1786400537.547311:0:12857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.547319:0:12857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.547347:0:12857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.547354:0:12857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.547463:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400537.547470:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.547477:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf200 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400537.547480:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.547499:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400537.547506:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400537.547512:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786400537.547515:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1786400537.547536:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.547542:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786400537.547607:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392981632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400537.547650:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400537.547776:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392981632 00000100:00100000:2.0:1786400537.547782:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392981632 00000100:00100000:2.0:1786400537.547832:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786400537.547840:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3316:x1873176392981632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400537.547848:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400537.547851:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400537.547857:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.547859:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.547861:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400537.547861:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b7a1f600/0x49554f35ff0a537f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a5378 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400537.547871:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400537.548095:0:12857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786400537.548100:0:12857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373bfebf200/0x49554f35ff0a5378 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a537f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400537.548110:0:12857:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1786400537.548118:0:12857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.548124:0:12857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.548131:0:12857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.548138:0:12857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.548148:0:12857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786400537.548151:0:12857:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1786400537.548153:0:12857:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1786400537.548180:0:12857:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1786400537.548185:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1786400537.548190:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400537.548201:0:12857:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1786400537.548206:0:12857:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9373bf7d2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786400537.548213:0:12857:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9373bf21d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786400537.548218:0:12857:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff937399f6b380) has exports, disconnecting them 00000020:00080000:0.0:1786400537.548222:0:12857:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9373bf7d2800), last request at 1786400534 00000020:00000080:0.0:1786400537.548229:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a503e 00000100:00080000:0.0:1786400537.548246:0:12857:0:(import.c:65:import_set_state_nolock()) ffff937399f15800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786400537.548290:0:12857:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9373bf7d2800): rc 0 00000020:00000080:0.0:1786400537.548292:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373bf7d2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1786400537.548304:0:12857:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9373bf21d800), last request at 1786400534 00000020:00000080:0.0:1786400537.548307:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4f73 00000100:00080000:0.0:1786400537.548313:0:12857:0:(import.c:65:import_set_state_nolock()) ffff9373b7b4c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786400537.548318:0:12857:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9373bf21d800): rc 0 00010000:00010000:3.0:1786400537.548510:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400537.548516:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.548523:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400537.548527:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.548534:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400537.548541:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400537.548554:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400537.548556:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1786400537.548558:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1786400537.548578:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.548584:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400537.548600:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.548606:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a4e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a4e31 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.548619:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.548621:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.548622:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400537.548628:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400537.548633:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400537.548644:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392981760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400537.548674:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400537.548707:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1786400537.548714:0:5800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000020:00000080:0.0:1786400537.549006:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373bf21d800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1786400537.549018:0:12857:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa4bd83febae0 00000100:00080000:0.0:1786400537.549160:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786400537.549164:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1786400537.549177:0:12857:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1786400537.549249:0:12857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1786400537.549262:0:12857:0:(import.c:65:import_set_state_nolock()) ffff9373b78fc000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1786400537.549275:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786400537.549277:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1786400537.549286:0:12857:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786400537.549429:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392981888:0@lo:9:umount.0 00000100:00100000:0.0:1786400537.549466:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786400537.549505:0:12857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1786400537.549515:0:12857:0:(import.c:65:import_set_state_nolock()) ffff9373b9c2b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1786400537.549532:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392982016:0@lo:9:umount.0 00000100:00100000:0.0:1786400537.549563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400537.549592:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392981888 00000100:00100000:0.0:1786400537.549598:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392981888 00000100:00100000:0.0:1786400537.549638:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392982016 00000100:00100000:0.0:1786400537.549641:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392982016 00000100:00100000:0.0:1786400537.549661:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786400537.549668:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873176392981888:12345-0@lo:9:umount.0 00000020:00000080:0.0:1786400537.549691:0:6623:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4fc0 00000100:00080000:0.0:1786400537.549697:0:6623:0:(import.c:65:import_set_state_nolock()) ffff9373bf259000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786400537.550000:0:6623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1786400537.550318:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3314:x1873176392981888:12345-0@lo:9:umount.0 Request processed in 649us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400537.550455:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392981760 00000100:00100000:3.0:1786400537.550460:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392981760 00000100:00100000:3.0:1786400537.550554:0:12858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400537.550563:0:12858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e769e6f-cf99-4814-98f1-5b8d54010374+16:3318:x1873176392981760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400537.550575:0:12858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400537.550590:0:12858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373994f5e00/0x49554f35ff0a4e31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a4e2a expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400537.550622:0:12858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400537.550655:0:12858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e769e6f-cf99-4814-98f1-5b8d54010374+15:3318:x1873176392981760:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400537.550662:0:12858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400537.550698:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392981760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400537.551275:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786400537.551294:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786400537.551303:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873176392982016:12345-0@lo:9:umount.0 00000020:00000080:0.0:1786400537.551332:0:6623:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a50ae 00000100:00080000:0.0:1786400537.551340:0:6623:0:(import.c:65:import_set_state_nolock()) ffff9373b04b5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786400537.551373:0:6623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1786400537.551615:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3314:x1873176392982016:12345-0@lo:9:umount.0 Request processed in 314us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400537.551621:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1786400537.551641:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400537.551645:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400537.551659:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786400537.551683:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b9c2b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1786400537.551695:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1786400537.551697:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786400537.551700:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392982016:0@lo:9:umount.0 00000100:00080000:0.0:1786400537.551735:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b78fc000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1786400537.551773:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1786400537.551775:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786400537.551779:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392981888:0@lo:9:umount.0 00000020:00080000:0.0:1786400537.552067:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff937399f6b380) has no exports 00000100:00100000:2.0:1786400537.552152:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e769e6f-cf99-4814-98f1-5b8d54010374+14:3316:x1873176392981632:12345-0@lo:103:ldlm_bl.0 Request processed in 4311us (4499us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400537.552160:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:2.0:1786400537.552274:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf7d2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1786400537.552313:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf21d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1786400537.552339:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff937399f15800 for lustre-MDT0000 00000020:00000080:2.0:1786400537.552348:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373b7b4c000 for lustre-MDT0000 00010000:00010000:3.0:1786400537.552767:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400537.553210:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e769e6f-cf99-4814-98f1-5b8d54010374:3316:1873176392981632:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1786400537.564168:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff937399f6b380) has no exports 00000020:00000080:0.0:1786400537.640606:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4e85 00000020:00000080:0.0:1786400537.640629:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b7b55000/lustre-QMT0000_UUID 00000020:01000000:0.0:1786400537.640713:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1786400537.640788:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400537.640809:0:12857:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786400537.640814:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9373b9c00000) has no exports 00000020:00000080:1.0:1786400537.641247:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4e7e 00000020:00000080:1.0:1786400537.641253:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b9c4c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786400537.641345:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b55000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1786400537.641527:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400537.641535:0:12857:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1786400537.641547:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b7b51800/lustre-QMT0000_UUID 00000020:00000080:1.0:1786400537.641550:0:12857:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b51800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1786400537.641558:0:12857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1786400537.641787:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b9c4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1786400537.642364:0:12857:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff937384071420 - data ffff9373aea7c870/ffff9373afe63c00 00000020:01000000:1.0:1786400537.642488:0:12857:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9373a9823000 - data ffff937398843a20/ffff9373b6eab000 00000001:00000004:1.0:1786400537.655945:0:12857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1786400537.718557:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1786400537.718566:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1786400537.718593:0:12857:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786400537.718596:0:12857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1786400537.718948:0:6761:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1786400537.718953:0:6761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1786400537.718963:0:6761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1786400537.719808:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1786400537.719813:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1786400537.719824:0:12857:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786400537.719827:0:12857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1786400537.720145:0:7822:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1786400537.720149:0:7822:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1786400537.720157:0:7822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1786400537.788127:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4e4d 00000020:00000080:0.0:1786400537.788140:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b7b54000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786400537.788268:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b54000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786400537.789702:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4e62 00000020:00000080:0.0:1786400537.789711:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b7b53800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1786400537.789727:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1786400537.789731:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786400537.789784:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b53800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1786400537.789886:0:12857:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1786400537.789892:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff937399f6cd40) has no exports 00000004:01000000:0.0:1786400537.790050:0:12857:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1786400537.790059:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a50a0 00000020:00000080:0.0:1786400537.790063:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b04b0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1786400537.790077:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1786400537.790081:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400537.790089:0:12857:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1786400537.790091:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b04b0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00080000:0.0:1786400537.790091:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9373b7b58000) has no exports 00000020:00000080:0.0:1786400537.790098:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a5099 00000020:00000080:0.0:1786400537.790111:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b7b49800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786400537.790151:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b49800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1786400537.791418:0:12857:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1786400537.791424:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786400537.791428:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1786400537.791434:0:12857:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786400537.791436:0:12857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786400537.791483:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786400537.791484:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373b9c2b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1786400537.791493:0:12857:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786400537.791497:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373bf7d0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786400537.791500:0:12857:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf7d0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1786400537.791510:0:12857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786400537.791606:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4fb9 00000020:00000080:1.0:1786400537.791620:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b78ff800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786400537.791636:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1786400537.791640:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400537.791645:0:12857:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786400537.791648:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9373b91eb380) has no exports 00000020:00000080:1.0:1786400537.791654:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4fb2 00000020:00000080:1.0:1786400537.791657:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b78fc800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786400537.791731:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b78ff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1786400537.791766:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b78fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1786400537.792130:0:12857:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1786400537.792134:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786400537.792136:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1786400537.792139:0:12857:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786400537.792141:0:12857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786400537.792171:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400537.792176:0:12857:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786400537.792205:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400537.792213:0:12857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786400537.792216:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373843ec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786400537.792219:0:12857:0:(genops.c:865:class_export_destroy()) destroying export ffff9373843ec000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1786400537.792223:0:12857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786400537.792227:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373b78fc000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1786400537.792232:0:38:0:(genops.c:906:class_export_put()) final put ffff9373c00b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786400537.792234:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373c00b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1786400537.792238:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786400537.792434:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4e69 00000020:00000080:1.0:1786400537.792439:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b7b50800/lustre-MDD0000_UUID 00000020:01000000:1.0:1786400537.792498:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1786400537.792502:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400537.792505:0:12857:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786400537.792507:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9373b7b5cd40) has no exports 00000020:00000080:1.0:1786400537.792525:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400537.792528:0:12857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1786400537.792531:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4e70 00000020:00000080:1.0:1786400537.792534:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b7b57800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1786400537.792633:0:12857:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9373910fb800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1786400537.792637:0:12857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373910fb800 3 00000020:01000004:1.0:1786400537.792640:0:12857:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9373910fb800 from lustre-MDT0000 00000020:00000080:1.0:1786400537.792666:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400537.792670:0:12857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1786400537.792673:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b7b54800/lustre-MDT0000_UUID 00000020:00000080:1.0:1786400537.792675:0:12857:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b54800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1786400537.792681:0:12857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1786400537.792705:0:12857:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1786400537.792709:0:12857:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1786400537.792711:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1786400537.792714:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400537.792717:0:12857:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1786400537.792722:0:12857:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff937386eee800 6e769e6f-cf99-4814-98f1-5b8d54010374 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786400537.792727:0:12857:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff937399f699c0) has exports, disconnecting them 00000020:00080000:1.0:1786400537.792731:0:12857:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff937386eee800), last request at 1786400293 00000020:00000080:1.0:1786400537.792813:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4e0e 00000020:00010000:1.0:1786400537.792817:0:12857:0:(genops.c:1942:obd_stale_export_put()) Put export ffff937386eee800: total 2 00000100:00080000:1.0:1786400537.792820:0:12857:0:(import.c:65:import_set_state_nolock()) ffff9373910fa000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1786400537.792830:0:12857:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff937386eee800): rc 0 00000020:00080000:1.0:1786400537.792833:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff937399f699c0) has no exports 00000020:00010000:0.0:1786400537.792952:0:5804:0:(genops.c:1928:obd_stale_export_get()) Get export ffff937386eee800: total 2 00000100:00100000:3.0:1786400537.792972:0:5810:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff937388d6b000:5810] 1 exiting: rc = 0 00010000:00010000:0.0:1786400537.792984:0:5804:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff937386eee800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1786400537.793010:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a5363 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a535c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.793024:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebe000/0x49554f35ff0a5371 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a536a expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.793038:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fcc00/0x49554f35ff0a4f26 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a4f1f expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.793058:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fca00/0x49554f35ff0a5164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a515d expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1786400537.793091:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b50800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1786400537.793096:0:38:0:(genops.c:906:class_export_put()) final put ffff9373b7b55800/lustre-MDD0000_UUID 00000020:00000080:2.0:1786400537.793097:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b55800/lustre-MDD0000_UUID for lustre-MDD0000 00010000:00010000:0.0:1786400537.793099:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fc800/0x49554f35ff0a511e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a5117 expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1786400537.793101:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:0.0:1786400537.793109:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fc400/0x49554f35ff0a5110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a5109 expref: 4 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.793119:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373c21fce00/0x49554f35ff0a512c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a5125 expref: 3 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.793127:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399762c00/0x49554f35ff0a513a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49554f35ff0a5133 expref: 2 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400537.793137:0:5804:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff937386eee800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1786400537.793149:0:5804:0:(genops.c:906:class_export_put()) final put ffff937386eee800/6e769e6f-cf99-4814-98f1-5b8d54010374 00010000:00010000:0.0:1786400537.793190:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400537.793192:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400537.793199:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400537.793233:0:5809:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff937385fd5000:5809] 0 exiting: rc = 1 00000100:00100000:0.0:1786400537.793285:0:5811:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff937388d6a400:5811] 2 exiting: rc = 0 00000100:00100000:0.0:1786400537.793635:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793644:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793650:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793655:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793661:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793666:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793672:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793678:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793684:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793690:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793696:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793702:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793708:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793713:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793719:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793724:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793886:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793894:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793900:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793906:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793911:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793916:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793921:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793926:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793931:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793937:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793942:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793947:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793952:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1786400537.793956:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b57800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1786400537.793958:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1786400537.793963:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff937386eee800/6e769e6f-cf99-4814-98f1-5b8d54010374 for MGS 00000100:00100000:0.0:1786400537.793964:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793969:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793984:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1786400537.793989:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373910fa000 for MGS 00000100:00100000:0.0:1786400537.793989:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.793994:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794000:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794005:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794011:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794015:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794021:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794025:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794030:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794035:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794040:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794046:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794051:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794056:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794061:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794066:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794071:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794076:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794080:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794085:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794090:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794096:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794101:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794107:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794112:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794117:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794123:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794128:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794133:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794139:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.794144:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1786400537.794895:0:12857:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1786400537.794899:0:12857:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1786400537.795907:0:12857:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff937399f26ae0 - data ffff9373aea21d80/ffff9373bf42f400 00000020:01000000:0.0:1786400537.796027:0:12857:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9373b0706b40 - data ffff93738fba25e8/ffff9373a0c58c00 00000020:00000080:0.0:1786400537.796630:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4df2 00000020:00000080:0.0:1786400537.796638:0:12857:0:(genops.c:906:class_export_put()) final put ffff937387c57000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1786400537.796686:0:12857:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9373910fb800 from MGS, refs=2 00000020:01000004:0.0:1786400537.796690:0:12857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373910fb800 2 00000020:01000004:0.0:1786400537.796693:0:12857:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9373910fb800 from MGS 00000020:00000080:0.0:1786400537.796714:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400537.796721:0:12857:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1786400537.796723:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373a0e19000/MGS 00000020:00000080:0.0:1786400537.796726:0:12857:0:(genops.c:865:class_export_destroy()) destroying export ffff9373a0e19000/MGS for MGS 00000020:01000000:0.0:1786400537.796736:0:12857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1786400537.796827:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1786400537.796831:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400537.796836:0:12857:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786400537.796842:0:12857:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9373b6efe000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786400537.796848:0:12857:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff937386ef8000) has exports, disconnecting them 00000020:00080000:0.0:1786400537.796852:0:12857:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9373b6efe000), last request at 1786400294 00000020:00000080:0.0:1786400537.796855:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4ebd 00000020:00080000:0.0:1786400537.796864:0:12857:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9373b6efe000): rc 0 00000020:00000080:0.0:1786400537.796868:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373b6efe000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1786400537.796986:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff937387c57000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786400537.797063:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b6efe000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1786400537.797780:0:12857:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1786400537.797785:0:12857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786400537.797789:0:12857:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1786400537.797804:0:12857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786400537.797919:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400537.797925:0:12857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1786400537.797930:0:12857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373910fb800 1 00000020:00000080:1.0:1786400537.797934:0:12857:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4de4 00000020:00000080:1.0:1786400537.797938:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373a0e1a800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1786400537.797942:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1786400537.797946:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400537.797957:0:12857:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786400537.797960:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff937386ef99c0) has no exports 00000020:00000080:2.0:1786400537.798110:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373b6efa000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1786400537.798117:0:8:0:(genops.c:906:class_export_put()) final put ffff9373b6ef8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1786400537.798119:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b6ef8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1786400537.798124:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1786400537.798183:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373a0e1a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786400537.838699:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786400537.838714:0:12857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1786400537.838719:0:12857:0:(genops.c:906:class_export_put()) final put ffff9373910fb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786400537.838723:0:12857:0:(genops.c:865:class_export_destroy()) destroying export ffff9373910fb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1786400537.838731:0:12857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1786400537.838904:0:12857:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9373910f8800 00000020:01000000:2.0:1786400537.838928:0:12857:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1786400537.838932:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786400537.838936:0:12857:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786400537.838940:0:12857:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff937399f68000) has no exports 00000100:00100000:2.0:1786400537.839011:0:5817:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff937399ea5600:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1786400537.839109:0:8098:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9373bfed9e00:8098] 3 exiting: rc = 0 00000100:00100000:1.0:1786400537.841367:0:5818:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9373843ce000:5818] 2 exiting: rc = 0 00000100:00100000:1.0:1786400537.841465:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff937399ea5000:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1786400537.841973:0:12769:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9373bf260000:12769] 4 exiting: rc = 0 00000100:00100000:2.0:1786400537.843531:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843540:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843546:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843551:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843556:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843560:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843565:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843570:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843576:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843582:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843586:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843592:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843597:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843604:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843609:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843619:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843626:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843631:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843637:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843643:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843648:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843665:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843671:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843676:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843681:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843687:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843693:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843699:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.843704:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844277:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844285:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844291:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844296:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844302:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844307:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844312:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844317:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844322:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844327:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844333:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844338:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844343:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844348:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844354:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844359:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844364:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844369:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844375:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844381:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844387:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844407:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844436:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844442:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844447:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844452:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844459:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844472:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844493:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844499:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844504:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844509:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844514:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844519:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.844523:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.851401:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9373843cca00:5819] 0 exiting: rc = 1 00000100:00100000:2.0:1786400537.851528:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9373843cea00:5820] 1 exiting: rc = 0 00000100:00100000:0.0:1786400537.852053:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852061:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852067:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852073:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852078:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852083:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852088:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852093:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852098:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852102:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852108:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852124:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852130:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852135:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852140:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852145:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852150:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852154:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852159:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852164:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852169:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1786400537.852171:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400537.852175:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852180:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852185:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852190:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852196:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852200:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852205:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852211:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852214:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852218:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852221:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852224:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852228:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852231:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852234:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852237:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852241:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852244:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852248:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852251:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852254:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852257:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852260:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852263:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852266:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852275:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852278:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852282:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852285:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852288:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852291:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852294:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852297:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852300:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852303:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852306:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852309:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852313:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852316:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852319:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852322:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852324:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.852328:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.853032:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9373843ccc00:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1786400537.854326:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9373843cd400:5822] 1 exiting: rc = 0 00000100:00100000:0.0:1786400537.856480:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856489:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856493:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856497:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856501:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856506:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856510:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856515:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856519:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856523:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856528:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856532:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856537:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856553:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856558:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856562:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856567:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856579:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856583:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856587:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856591:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856597:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856603:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856608:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856614:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856635:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856642:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856648:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856653:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856658:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856664:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856670:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856677:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856683:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856689:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856696:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856703:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856722:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856728:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.856732:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857018:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857026:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857031:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857034:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857039:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857044:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857048:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857052:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857056:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857072:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857078:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857083:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857093:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857097:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857102:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857106:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857110:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857114:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857118:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857122:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857126:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857130:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857135:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.857143:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400537.876995:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9373980b1e00:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1786400537.878041:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93739808e000:5823] 0 exiting: rc = 1 00000100:00100000:2.0:1786400537.878523:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878532:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878537:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878542:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878547:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878552:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878558:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878563:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878568:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878572:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878577:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878582:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878586:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878591:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878597:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878602:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878607:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878612:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878616:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878621:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878626:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878631:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878636:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878642:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878647:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878669:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878674:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878678:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878683:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878687:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878693:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878697:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878702:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878707:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878713:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878718:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878724:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878729:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878733:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878808:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878815:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878820:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878824:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878828:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878833:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878839:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878844:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878850:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878855:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878859:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878864:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878869:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878874:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878878:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878882:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878887:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878892:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878898:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878903:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878908:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878921:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878925:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878930:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400537.878935:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.881283:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9373843ce400:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1786400537.883269:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93739808e800:5825] 0 exiting: rc = 1 00000100:00100000:1.0:1786400537.884719:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884728:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884733:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884893:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884901:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884907:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884912:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884917:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884922:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884927:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884931:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884936:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884941:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884946:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884951:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884956:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884962:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884967:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884971:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884976:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884982:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884986:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884991:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.884996:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885001:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885006:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885025:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885030:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885034:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885039:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885044:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885049:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885053:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885057:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885063:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885067:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885072:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885076:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885081:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885085:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885090:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885094:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885099:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885104:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885108:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885113:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885118:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885123:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885128:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885134:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885139:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885144:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885149:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885154:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885158:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885163:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885167:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885172:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885177:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885182:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885187:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885199:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885204:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.885209:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400537.885847:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff937388d89200:5827] 0 exiting: rc = 1 00000100:00100000:3.0:1786400537.886046:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff937388d89600:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1786400537.886088:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886095:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886100:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886106:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886112:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886117:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886122:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886127:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886132:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886137:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886143:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886149:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886153:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886159:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886163:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886168:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886172:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886177:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886182:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886188:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886193:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886198:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886202:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886207:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886211:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886216:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886220:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886225:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886229:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886234:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886239:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886244:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886259:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886264:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886270:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886275:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886279:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886284:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886290:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886295:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886299:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886303:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886308:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886313:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886318:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886894:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886904:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886909:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886916:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886921:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886926:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886931:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886936:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886942:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886947:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886952:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886957:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886963:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886968:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886973:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886978:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886983:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886987:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.886992:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400537.887706:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93739808f400:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1786400537.888088:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9373a0cdaa00:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1786400537.888263:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9373a0cdbc00:5831] 2 exiting: rc = 0 00000100:00100000:1.0:1786400537.888317:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888428:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888434:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888440:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888446:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888452:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888458:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888464:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888470:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888475:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888481:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888486:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888492:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888497:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888517:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888524:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888530:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888535:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888541:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888547:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888552:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888558:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888563:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888568:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888573:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888579:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888584:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888589:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888594:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888600:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888606:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888612:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888617:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888623:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888628:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888635:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888649:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888655:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888675:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888681:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888688:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888694:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888700:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888705:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888711:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888717:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888723:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888729:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888733:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888876:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888884:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888890:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888896:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888901:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888907:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888913:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888919:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888924:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888930:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888936:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888943:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888949:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888954:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400537.888959:0:12857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1786400537.896224:0:12857:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400537.896237:0:12857:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1786400537.896242:0:12857:0:(genops.c:906:class_export_put()) final put ffff937387c55000/MDS_uuid 00000020:00000080:0.0:1786400537.896247:0:12857:0:(genops.c:865:class_export_destroy()) destroying export ffff937387c55000/MDS_uuid for MDS 00000020:01000000:0.0:1786400537.896252:0:12857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1786400537.896383:0:12857:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1786400538.898894:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400539.553070:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392982144:0@lo:400:kworker.0 00000400:00000100:0.0:1786400539.553357:0:3318:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873176392982144 offset 0 length 224: 4 00000100:00100000:2.0:1786400539.553764:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392982272:0@lo:400:kworker.0 00000400:00000100:2.0:1786400539.554011:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176392982272 offset 0 length 224: 4 00000100:00100000:1.0:1786400539.554120:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392982400:0@lo:400:kworker.0 00000400:00000100:1.0:1786400539.554145:0:3316:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176392982400 offset 0 length 224: 4 00010000:00010000:0.0:1786400539.924518:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400540.947338:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786400541.155022:0:13007:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1786400541.170145:0:13007:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1786400541.170345:0:13007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400541.170447:0:13007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400541.170455:0:13007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400541.170461:0:13007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400541.170485:0:13007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786400541.170490:0:13007:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1786400541.170580:0:13007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786400541.170592:0:13007:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93728239f800 x1873176392982272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400555 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400541.170614:0:13007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1786400541.170619:0:13007:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1786400541.170644:0:13007:0:(import.c:65:import_set_state_nolock()) ffff9373a99dd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786400541.170772:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392982272:0@lo:400:kworker.0 00000100:00100000:3.0:1786400541.170844:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1873176392982528:0@lo:39:umount.0 00010000:00010000:0.0:1786400541.170863:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400541.170870:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400541.170878:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380031800 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:0.0:1786400541.170881:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400541.170901:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400541.170908:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400541.170914:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786400541.170917:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1786400541.170919:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1786400541.170944:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400541.170950:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000400:00000100:3.0:1786400541.170963:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176392982528 offset 0 length 224: 4 00010000:00010000:0.0:1786400541.170972:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400541.170979:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937380031800/0x49554f35ff0a5125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x49554f35ff0a512c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400541.170990:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400541.170992:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400541.170994:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400541.171118:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400541.171128:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392982656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400541.171415:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400541.171568:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392982656 00000100:00100000:3.0:1786400541.171576:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392982656 00000100:00100000:3.0:1786400541.171623:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786400541.171630:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3318:x1873176392982656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1786400541.171637:0:5800:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786400541 with bad export cookie 5284216831119871502 00000100:00100000:0.0:1786400541.182012:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3318:x1873176392982656:12345-0@lo:103:ldlm_bl.0 Request processed in 10371us (10838us total) trans 0 rc -107/-107 00000100:00100000:0.0:1786400541.182026:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1786400541.182162:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786400541.182169:0:3318:0:(import.c:65:import_set_state_nolock()) ffff937386ee8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1786400541.182173:0:3318:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1786400541.191610:0:3318:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.123@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1786400541.191616:0:3318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1786400541.191626:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93728239c380 x1873176392982144/t0(0) o400->MGC192.168.201.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786400555 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400541.191659:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff937282723800 x1873176392982656/t0(0) o103->MGC192.168.201.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1786400557 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1786400541.191669:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1786400541.191671:0:3318:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1786400541.191672:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1786400541.191676:0:3318:0:(import.c:65:import_set_state_nolock()) ffff937386ee8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786400541.191691:0:3318:0:(import.c:510:import_select_connection()) MGC192.168.201.123@tcp: connect to NID 0@lo last attempt 214 00000100:00080000:1.0:1786400541.191700:0:3318:0:(import.c:624:import_select_connection()) MGC192.168.201.123@tcp: import ffff937386ee8800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1786400541.191730:0:3318:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b7721180 x1873176392982784/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786400541.191799:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392982144:0@lo:400:kworker.0 00000100:00100000:0.0:1786400541.191810:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e769e6f-cf99-4814-98f1-5b8d54010374:3314:1873176392982784:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:1.0:1786400541.191824:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e769e6f-cf99-4814-98f1-5b8d54010374:3318:1873176392982656:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1786400541.191854:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873176392982784 offset 0 length 520: 4 00000001:00100000:2.0:1786400541.661092:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786400541.661119:0:6647:0:(genops.c:906:class_export_put()) final put ffff9373bf25f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786400541.661156:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf25f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1786400541.661313:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373bf259000 for lustre-OST0000 00010000:00010000:0.0:1786400541.971437:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786400542.193956:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786400542.193967:0:7536:0:(genops.c:906:class_export_put()) final put ffff9373b04b3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786400542.194214:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b04b3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1786400542.194415:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373b04b5000 for lustre-OST0001 00010000:00010000:0.0:1786400542.994994:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400544.022376:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786400544.658834:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786400544.658847:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786400544.658990:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400544.659023:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392982912:0@lo:400:kworker.0 00000400:00000100:2.0:1786400544.659082:0:3317:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176392982912 offset 0 length 224: 4 00010000:00010000:0.0:1786400545.043034:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786400545.684320:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786400545.684343:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1786400545.685098:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400545.685145:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392983040:0@lo:400:kworker.0 00000400:00000100:0.0:1786400545.685208:0:3316:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176392983040 offset 0 length 224: 4 00010000:00010000:0.0:1786400546.071575:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400547.090979:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400548.115781:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400549.139445:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400550.163103:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786400550.803271:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786400550.803318:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786400550.803547:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400550.803567:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392983168:0@lo:400:kworker.0 00000400:00000100:2.0:1786400550.803664:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176392983168 offset 0 length 224: 4 00010000:00010000:0.0:1786400551.187659:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400551.317292:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400541/real 1786400541] req@ffff9373b7721180 x1873176392982784/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786400551 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400551.317328:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9373b7721180 x1873176392982784/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786400551 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400551.317339:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400541/real 1786400541] req@ffff9373b7722d80 x1873176392982528/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786400551 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400551.317352:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9373b7722d80 x1873176392982528/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786400551 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786400551.317369:0:3314:0:(import.c:65:import_set_state_nolock()) ffff937386ee8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786400551.317397:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1786400551.317401:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e769e6f-cf99-4814-98f1-5b8d54010374:3314:1873176392982784:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1786400551.317408:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373a99dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1786400551.317425:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1873176392982528:0@lo:39:umount.0 00000100:00080000:2.0:1786400551.317955:0:13007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786400551.317971:0:13007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1786400551.318232:0:13007:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1786400551.321386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786400551.321396:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1786400551.321401:0:8:0:(import.c:65:import_set_state_nolock()) ffff937386ee8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786400551.321410:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.123@tcp: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1786400551.321417:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.123@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786400551.321425:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.123@tcp: import ffff937386ee8800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1786400551.321460:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b7720a80 x1873176392983296/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786400551.321556:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400551.321595:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392983424:0@lo:400:kworker.0 00000400:00000100:1.0:1786400551.321649:0:3318:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176392983424 offset 0 length 224: 4 00010000:00010000:2.0:1786400551.321853:0:13007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400551.321867:0:13007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400551.321875:0:13007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400551.321882:0:13007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400551.321914:0:13007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400551.321921:0:13007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400551.321929:0:13007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400551.321935:0:13007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400551.321942:0:13007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400551.321959:0:13007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1786400551.321970:0:13007:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1786400551.322052:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786400551.322060:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400551.322069:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5000 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400551.322073:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400551.322082:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400551.322090:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400551.322096:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400551.322098:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1786400551.322101:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1786400551.322118:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937386ee8800 00010000:00010000:3.0:1786400551.322122:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400551.322129:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f5000/0x49554f35ff0a5133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a513a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400551.322141:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400551.322145:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400551.322160:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f000 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400551.322170:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400551.322178:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400551.322184:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400551.322189:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786400551.322191:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1786400551.322192:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1786400551.322198:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937386ee8800 00010000:00010000:3.0:1786400551.322200:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400551.322205:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f000/0x49554f35ff0a536a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a5371 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400551.322214:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400551.322216:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400551.322217:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400551.322854:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400551.323246:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e769e6f-cf99-4814-98f1-5b8d54010374:3314:1873176392983296:0@lo:250:kworker.0 00000400:00000100:0.0:1786400551.323295:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873176392983296 offset 0 length 520: 4 00000020:01000004:2.0:1786400551.323636:0:13007:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1786400551.323641:0:13007:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1786400551.323646:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786400551.323652:0:13007:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786400551.323656:0:13007:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff937386efb380) has no exports 00000020:00080000:2.0:1786400551.323680:0:13007:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff937386efb380) has no exports 00000020:01000000:2.0:1786400551.336641:0:13007:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff937399f266c0 - data ffff9373aea21e58/ffff9373bf42fc00 00000020:01000000:2.0:1786400551.337347:0:13007:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff937384d884e0 - data ffff93738fbd60d8/ffff9373b7220000 00100000:10000000:1.0:1786400551.357610:0:13007:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1786400551.435043:0:13007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4f42 00000020:00000080:2.0:1786400551.435052:0:13007:0:(genops.c:906:class_export_put()) final put ffff9373c00b4000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1786400551.435080:0:13007:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9373b7b4b000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1786400551.435083:0:13007:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373b7b4b000 2 00000020:01000004:2.0:1786400551.435087:0:13007:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9373b7b4b000 from lustre-OST0000 00000020:00000080:2.0:1786400551.435110:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786400551.435132:0:13007:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1786400551.435135:0:13007:0:(genops.c:906:class_export_put()) final put ffff9373c00b2800/lustre-OST0000_UUID 00000020:00000080:2.0:1786400551.435138:0:13007:0:(genops.c:865:class_export_destroy()) destroying export ffff9373c00b2800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1786400551.435144:0:13007:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1786400551.435184:0:13007:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1786400551.435188:0:13007:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1786400551.435191:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786400551.435195:0:13007:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1786400551.435201:0:13007:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9373bf21f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786400551.435207:0:13007:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9373b9c04d40) has exports, disconnecting them 00000020:00080000:2.0:1786400551.435211:0:13007:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9373bf21f000), last request at 1786400312 00000020:00000080:2.0:1786400551.435215:0:13007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4f6c 00000020:00080000:2.0:1786400551.435223:0:13007:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9373bf21f000): rc 0 00000020:00000080:2.0:1786400551.435227:0:13007:0:(genops.c:906:class_export_put()) final put ffff9373bf21f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1786400551.435932:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373c00b4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1786400551.435944:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf21f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1786400551.438088:0:13007:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1786400551.438096:0:13007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786400551.438100:0:13007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1786400551.438106:0:13007:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786400551.438465:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786400551.438474:0:13007:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1786400551.438485:0:13007:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373b7b4b000 1 00000020:00000080:3.0:1786400551.438492:0:13007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4efc 00000020:00000080:3.0:1786400551.438499:0:13007:0:(genops.c:906:class_export_put()) final put ffff937399f14000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1786400551.438524:0:13007:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1786400551.438529:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786400551.438533:0:13007:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1786400551.438537:0:13007:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff937386efcd40) has no exports 00000020:00000080:0.0:1786400551.438592:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373a99dd800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1786400551.438601:0:8:0:(genops.c:906:class_export_put()) final put ffff9373bf21e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1786400551.438603:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf21e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1786400551.438611:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1786400551.438664:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff937399f14000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1786400551.484603:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400551.484618:0:13007:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1786400551.484624:0:13007:0:(genops.c:906:class_export_put()) final put ffff9373b7b48800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1786400551.484628:0:13007:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b7b48800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1786400551.484638:0:13007:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1786400551.484774:0:13007:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9373b7b4f800 00000020:02000400:0.0:1786400551.484832:0:13007:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1786400552.214304:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400553.235071:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400554.259016:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786400554.546426:0:13163:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1786400554.556600:0:13163:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1786400554.557729:0:13163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400554.557774:0:13163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400554.557782:0:13163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400554.557788:0:13163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400554.557864:0:13163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786400554.557871:0:13163:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1786400554.557892:0:13163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786400554.557902:0:13163:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93728239e300 x1873176392982400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400555 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400554.557935:0:13163:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93728239dc00 x1873176392982912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400554.557946:0:13163:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93728239ed80 x1873176392983040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400554.557963:0:13163:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9373b7722680 x1873176392983168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400566 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400554.557973:0:13163:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9373b7723480 x1873176392983424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400554.557997:0:13163:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1786400554.558003:0:13163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1786400554.558031:0:13163:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1786400554.558071:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1873176392983552:0@lo:39:umount.0 00000400:00000100:1.0:1786400554.558130:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176392983552 offset 0 length 224: 4 00000100:00100000:3.0:1786400554.558288:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392983040:0@lo:400:kworker.0 00000100:00100000:3.0:1786400554.558294:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176392982400:0@lo:400:kworker.0 00000100:00100000:3.0:1786400554.558317:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392982912:0@lo:400:kworker.0 00010000:00010000:2.0:1786400554.558447:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400554.558462:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400554.558470:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937380030400 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400554.558473:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400554.558482:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400554.558489:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400554.558495:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786400554.558497:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1786400554.558505:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1786400554.558518:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937386ee8800 00010000:00010000:2.0:1786400554.558522:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400554.558528:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937380030400/0x49554f35ff0a5109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a5110 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400554.558539:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400554.558541:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400554.558543:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400554.558558:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176392983168:0@lo:400:kworker.0 00000100:00100000:2.0:1786400554.558579:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392983424:0@lo:400:kworker.0 00010000:00010000:0.0:1786400555.284371:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400556.308089:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786400556.435317:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786400556.435328:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1786400557.332250:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400558.357041:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400559.385569:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400560.403033:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400561.427210:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786400561.554945:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786400561.554956:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1786400562.456676:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400563.475232:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400564.500583:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400564.754887:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400554/real 1786400554] req@ffff9373b7723100 x1873176392983552/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786400564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400564.754926:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9373b7723100 x1873176392983552/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786400564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786400564.754947:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373bf7d2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1786400564.754975:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1873176392983552:0@lo:39:umount.0 00000100:00080000:3.0:1786400564.755093:0:13163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786400564.755099:0:13163:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1786400564.755105:0:13163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1786400564.756179:0:13163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400564.756197:0:13163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400564.756222:0:13163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400564.756229:0:13163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400564.756266:0:13163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786400564.756281:0:13163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400564.756308:0:13163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400564.756314:0:13163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400564.756321:0:13163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400564.756346:0:13163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1786400564.756350:0:13163:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1786400564.756370:0:13163:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1786400564.756375:0:13163:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1786400564.756379:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786400564.756384:0:13163:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1786400564.756387:0:13163:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9373b9c03380) has no exports 00000020:00080000:3.0:1786400564.756411:0:13163:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9373b9c03380) has no exports 00000020:01000000:3.0:1786400564.758117:0:13163:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff937399f26cc0 - data ffff9372815855e8/ffff9373bf42e400 00010000:00010000:2.0:1786400564.758498:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786400564.758507:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400564.758518:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5800 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400564.758523:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400564.758533:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400564.758541:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400564.758559:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786400564.758562:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1786400564.758565:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1786400564.758591:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937386ee8800 00010000:00010000:2.0:1786400564.758595:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400564.758601:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f5800/0x49554f35ff0a5117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a511e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400564.758613:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400564.758617:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400564.758623:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373c2177e00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400564.758625:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400564.758631:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400564.758636:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400564.758641:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1786400564.758644:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1786400564.758645:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1786400564.758650:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937386ee8800 00010000:00010000:2.0:1786400564.758653:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400564.758666:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373c2177e00/0x49554f35ff0a535c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a5363 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400564.758681:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400564.758682:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400564.758684:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400564.759438:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1786400564.769968:0:13163:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff937399f1ca80 - data ffff9373a9c6a5e8/ffff9373b9358000 00100000:10000000:3.0:1786400564.784096:0:13163:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1786400564.835942:0:13163:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a500d 00000020:00000080:0.0:1786400564.835953:0:13163:0:(genops.c:906:class_export_put()) final put ffff9373bf3f4000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1786400564.835963:0:13163:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9373bf25e800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1786400564.835966:0:13163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373bf25e800 2 00000020:01000004:0.0:1786400564.835969:0:13163:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9373bf25e800 from lustre-OST0001 00000020:00000080:0.0:1786400564.835992:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400564.836001:0:13163:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1786400564.836004:0:13163:0:(genops.c:906:class_export_put()) final put ffff9373bf3f4800/lustre-OST0001_UUID 00000020:00000080:0.0:1786400564.836007:0:13163:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf3f4800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1786400564.836014:0:13163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1786400564.836091:0:13163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6e769e6f-cf99-4814-98f1-5b8d54010374->MGS 00010000:00010000:0.0:1786400564.836107:0:13163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a4f26 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400564.836119:0:13163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a4f26 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400564.836125:0:13163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1786400564.836128:0:13163:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1786400564.836131:0:13163:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1786400564.836148:0:13163:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937386ee8800 00010000:00010000:0.0:1786400564.836152:0:13163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a4f1f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a4f26 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400564.836167:0:13163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x49554f35ff0a5164 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400564.836174:0:13163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x49554f35ff0a5164 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400564.836179:0:13163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786400564.836181:0:13163:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1786400564.836193:0:13163:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1786400564.836209:0:13163:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937386ee8800 00010000:00010000:0.0:1786400564.836213:0:13163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373994f4e00/0x49554f35ff0a515d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x49554f35ff0a5164 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786400564.836229:0:13163:0:(import.c:65:import_set_state_nolock()) ffff937386ee8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1786400564.836233:0:13163:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1786400564.836235:0:13163:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1786400564.836236:0:13163:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1786400564.836239:0:13163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1786400564.836264:0:13163:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9373b7720a80 x1873176392983296/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1786400566 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1786400564.836375:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf3f4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1786400564.836593:0:13163:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1786400564.836597:0:13163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1786400564.841099:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e769e6f-cf99-4814-98f1-5b8d54010374:3314:1873176392983296:0@lo:250:kworker.0 10000000:01000000:0.0:1786400564.841190:0:13163:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1786400564.841203:0:13163:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4e00 00000020:00000080:0.0:1786400564.841211:0:13163:0:(genops.c:906:class_export_put()) final put ffff937387c56800/6e769e6f-cf99-4814-98f1-5b8d54010374 00000020:01000000:0.0:1786400564.841230:0:13163:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.123@tcp (flags='') 00000020:00000080:0.0:1786400564.841237:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400564.841243:0:13163:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786400564.841247:0:13163:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9373a0c50000) has no exports 00000020:00000080:1.0:1786400564.841317:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff937387c56800/6e769e6f-cf99-4814-98f1-5b8d54010374 for MGC192.168.201.123@tcp 10000000:01000000:2.0:1786400564.841473:0:5813:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1786400564.841608:0:13163:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.123@tcp: client import never connected 00000100:00080000:0.0:1786400564.841612:0:13163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1786400564.841615:0:13163:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1786400564.841618:0:13163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1786400564.841620:0:13163:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1786400564.841665:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400564.841672:0:13163:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.123@tcp (uuid 6e769e6f-cf99-4814-98f1-5b8d54010374) 00000020:01000000:0.0:1786400564.841678:0:13163:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1786400564.841681:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400564.841685:0:13163:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786400564.841689:0:13163:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9373bf7d6000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786400564.841707:0:13163:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9373b7b599c0) has exports, disconnecting them 00000020:00080000:0.0:1786400564.841712:0:13163:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9373bf7d6000), last request at 1786400333 00000020:00000080:0.0:1786400564.841715:0:13163:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a5037 00000020:00080000:0.0:1786400564.841727:0:13163:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9373bf7d6000): rc 0 00000020:00000080:0.0:1786400564.841730:0:13163:0:(genops.c:906:class_export_put()) final put ffff9373bf7d6000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1786400564.842660:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff937386ee8800 for MGC192.168.201.123@tcp 00000020:00000080:1.0:1786400564.842669:0:8:0:(genops.c:906:class_export_put()) final put ffff937386eef800/6e769e6f-cf99-4814-98f1-5b8d54010374 00000020:00000080:1.0:1786400564.842672:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff937386eef800/6e769e6f-cf99-4814-98f1-5b8d54010374 for MGC192.168.201.123@tcp 00000020:01000000:1.0:1786400564.842679:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.123@tcp (6e769e6f-cf99-4814-98f1-5b8d54010374) 00000020:00000080:1.0:1786400564.842954:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf7d6000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1786400564.852904:0:13163:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1786400564.852915:0:13163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786400564.852920:0:13163:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1786400564.852927:0:13163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1786400564.852989:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1786400564.853114:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1786400564.853231:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9373a10fe000:5799] 1 exiting: rc = 0 00000020:00000080:2.0:1786400564.853301:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9373bf7d2000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1786400564.853630:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9373a10ff200:5798] 0 exiting: rc = 1 00000100:00100000:1.0:1786400564.853791:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.854046:0:12858:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9373bf48a000:12858] 3 exiting: rc = 0 00000100:00100000:2.0:1786400564.854147:0:5802:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9373a10ff400:5802] 2 exiting: rc = 0 00000100:00100000:2.0:1786400564.854205:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9373a10ffc00:5801] 1 exiting: rc = 0 00000100:00100000:1.0:1786400564.876011:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9373a10fec00:5800] 0 exiting: rc = 1 00000100:00100000:1.0:1786400564.876124:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876132:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876138:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876143:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876150:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876156:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876162:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876166:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876172:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876177:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876182:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876187:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876192:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876197:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876203:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876208:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876214:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876219:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876224:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876229:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876233:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876238:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876243:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876248:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876253:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876259:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876264:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876269:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876284:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876289:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876294:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876309:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876314:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876320:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876324:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876339:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876345:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876350:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876354:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876359:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876364:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876369:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876374:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876379:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876384:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876389:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876394:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876399:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876403:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876408:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876413:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876418:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876422:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876427:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876432:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876436:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876441:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876446:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876451:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876466:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876472:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876477:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876483:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.876488:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1786400564.877179:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400564.877189:0:13163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1786400564.877202:0:13163:0:(genops.c:906:class_export_put()) final put ffff9373bf7d5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1786400564.877207:0:13163:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf7d5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1786400564.877212:0:13163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1786400564.877254:0:13163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373bf25e800 1 00000020:00000080:1.0:1786400564.877261:0:13163:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49554f35ff0a4fdc 00000020:00000080:1.0:1786400564.877266:0:13163:0:(genops.c:906:class_export_put()) final put ffff9373b9c5b800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1786400564.877291:0:13163:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1786400564.877296:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400564.877301:0:13163:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786400564.877304:0:13163:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9373b91e99c0) has no exports 00000020:00000080:2.0:1786400564.877529:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9373b9c5b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1786400564.907698:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400564.907718:0:13163:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1786400564.907725:0:13163:0:(genops.c:906:class_export_put()) final put ffff9373bf25a000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1786400564.907730:0:13163:0:(genops.c:865:class_export_destroy()) destroying export ffff9373bf25a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1786400564.907767:0:13163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1786400564.907996:0:13163:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9373bf25c000 00000020:01000000:1.0:1786400564.908019:0:13163:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1786400564.908025:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400564.908030:0:13163:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1786400564.908034:0:13163:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9373b7b5b380) has no exports 00000020:00000080:1.0:1786400564.908060:0:13163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400564.908070:0:13163:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1786400564.908073:0:13163:0:(genops.c:906:class_export_put()) final put ffff937399f17000/OSS_uuid 00000020:00000080:1.0:1786400564.908075:0:13163:0:(genops.c:865:class_export_destroy()) destroying export ffff937399f17000/OSS_uuid for OSS 00000020:01000000:1.0:1786400564.908082:0:13163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1786400564.911560:0:10836:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9373b8f94c00:10836] 3 exiting: rc = 0 00000100:00080000:0.0:1786400564.912694:0:5812:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1786400564.912867:0:6623:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff937391b2b400:6623] 1 exiting: rc = 0 00000100:00100000:0.0:1786400564.912915:0:6624:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff937391b2a200:6624] 2 exiting: rc = 0 00000100:00100000:0.0:1786400564.912972:0:6622:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9373b0587400:6622] 0 exiting: rc = 1 00000100:00100000:2.0:1786400564.917056:0:11904:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff93738db85200:11904] 4 exiting: rc = 0 00000100:00100000:2.0:1786400564.917201:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917209:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917216:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917223:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917228:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917234:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917239:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917244:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917249:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917254:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917259:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.917265:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920676:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920704:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920710:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920767:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920775:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920781:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920787:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920793:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920799:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920805:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920810:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920815:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920822:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920832:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920838:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920845:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920851:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920857:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920864:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920869:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920874:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920883:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920889:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920895:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920901:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920907:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920912:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920917:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920921:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920926:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920931:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920936:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920941:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920946:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920951:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920957:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920962:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920968:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920983:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920987:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920993:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.920998:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921003:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921009:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921014:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921019:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921023:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921028:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921034:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921040:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921046:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.921051:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.923563:0:6625:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff937388c24c00:6625] 0 exiting: rc = 1 00000100:00100000:2.0:1786400564.923814:0:6627:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff937388c25400:6627] 1 exiting: rc = 0 00000100:00100000:2.0:1786400564.924887:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924897:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924903:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924908:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924913:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924918:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924923:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924928:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924933:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924937:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924942:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924947:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924952:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924957:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924963:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924967:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924972:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924978:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924985:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.924992:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925018:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925024:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925032:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925038:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925044:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925051:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925058:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925063:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925068:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925073:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925078:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925083:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925088:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925093:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925098:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925102:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925107:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925111:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925116:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925120:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925125:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925130:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925135:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925140:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925145:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925150:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925155:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925161:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925165:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925170:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925175:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925180:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925186:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925191:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925196:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925211:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925215:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925220:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925225:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925230:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925235:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925240:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925246:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.925252:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.926145:0:6629:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9373b0587e00:6629] 1 exiting: rc = 0 00000100:00100000:1.0:1786400564.932020:0:6628:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff937391b2b800:6628] 0 exiting: rc = 1 00000100:00100000:1.0:1786400564.932244:0:6630:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93739860be00:6630] 2 exiting: rc = 0 00000100:00100000:2.0:1786400564.932575:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932583:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932588:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932604:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932610:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932616:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932621:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932627:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932633:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932639:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932645:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932650:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932655:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932661:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932667:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932672:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932677:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932682:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932687:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932693:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932699:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932704:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932709:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932714:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932719:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932764:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932772:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932793:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932802:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932807:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932813:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932818:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932823:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932828:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932834:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932839:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932845:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932851:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932857:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932863:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932868:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932874:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932880:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932885:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932891:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932896:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932901:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932908:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932914:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932919:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932924:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932929:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932945:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932951:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932957:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932963:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932970:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932976:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932981:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932987:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.932997:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.933002:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.933008:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.933013:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400564.941243:0:6631:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff937388c24a00:6631] 0 exiting: rc = 1 00000100:00100000:0.0:1786400564.941725:0:6632:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff937388c25c00:6632] 1 exiting: rc = 0 00000100:00100000:2.0:1786400564.946608:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946621:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946627:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946632:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946637:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946642:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946648:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946652:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946657:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946662:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946668:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946673:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946678:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946683:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946690:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946695:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946701:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946706:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946713:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946719:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946723:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946728:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946733:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946764:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946770:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946775:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946781:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946786:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946791:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946796:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946801:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946820:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946825:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946830:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946835:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946840:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946845:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946850:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946855:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946861:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946866:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946871:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946876:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946880:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946885:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946890:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946894:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946899:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946904:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946908:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946919:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946925:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946930:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946935:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946940:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946945:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946949:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946954:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946960:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946966:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946971:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946976:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946981:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.946987:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948036:0:6634:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9373b9d79200:6634] 1 exiting: rc = 0 00000100:00100000:1.0:1786400564.948230:0:6633:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9373b9d78600:6633] 0 exiting: rc = 1 00000100:00100000:2.0:1786400564.948512:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948532:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948537:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948542:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948548:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948554:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948560:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948566:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948581:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948587:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948593:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948598:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948604:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948610:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948615:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948620:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948626:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948632:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948637:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948642:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948660:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948666:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948671:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948678:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948686:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948691:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948697:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948703:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948710:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948717:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948723:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948729:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948776:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948784:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948790:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948796:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948807:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948813:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948819:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948825:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948831:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948836:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948842:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948848:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948865:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948873:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948881:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948889:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948897:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948907:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948917:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948924:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948934:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948942:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948950:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948958:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948985:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.948993:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.949000:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.949007:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.949014:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.949021:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.949028:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400564.949035:0:13163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1786400564.965612:0:13163:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1786400583.153374:0:13781:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1786400591.348168:0:14193:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786400591.348174:0:14193:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1786400591.348318:0:14193:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff937399fd8000 00000020:01000004:3.0:1786400591.348333:0:14193:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1786400591.348341:0:14193:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1786400591.348354:0:14193:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9373b7b5b380) 00000020:00000080:3.0:1786400591.348368:0:14193:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1786400591.387853:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1786400591.393720:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1786400591.394149:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 431: rc = 0 00100000:10000000:2.0:1786400591.394295:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 431: rc = 0 00100000:10000000:2.0:1786400591.394492:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1786400591.394561:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 431: rc = 0 00100000:10000000:2.0:1786400591.394654:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 431: rc = 0 00100000:10000000:2.0:1786400591.394775:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 431: rc = 0 00100000:10000000:0.0:1786400591.398074:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 431: rc = 0 00100000:10000000:0.0:1786400591.398396:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 433: rc = 0 00100000:10000000:0.0:1786400591.399437:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 572: rc = 0 00100000:10000000:0.0:1786400591.399536:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 572: rc = 0 00100000:10000000:0.0:1786400591.400003:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:0.0:1786400591.400260:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:0.0:1786400591.400599:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 770: rc = 0 00100000:10000000:1.0:1786400591.408180:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 770: rc = 0 00100000:10000000:1.0:1786400591.408996:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:1.0:1786400591.409270:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 770: rc = 0 00100000:10000000:1.0:1786400591.409795:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:1.0:1786400591.410055:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 770: rc = 0 00100000:10000000:1.0:1786400591.410296:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 770: rc = 0 00100000:10000000:1.0:1786400591.410925:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 770: rc = 0 00100000:10000000:1.0:1786400591.411172:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:1.0:1786400591.411554:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:1.0:1786400591.412236:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 594: rc = 0 00100000:10000000:1.0:1786400591.412878:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 594: rc = 0 00100000:10000000:1.0:1786400591.413126:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 594: rc = 0 00100000:10000000:1.0:1786400591.413368:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 594: rc = 0 00100000:10000000:1.0:1786400591.413863:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 594: rc = 0 00100000:10000000:1.0:1786400591.414101:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 594: rc = 0 00100000:10000000:1.0:1786400591.414338:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 594: rc = 0 00100000:10000000:1.0:1786400591.414916:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 594: rc = 0 00100000:10000000:1.0:1786400591.415165:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 594: rc = 0 00100000:10000000:1.0:1786400591.415550:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 594: rc = 0 00100000:10000000:1.0:1786400591.416048:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 594: rc = 0 00100000:10000000:1.0:1786400591.416282:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 594: rc = 0 00100000:10000000:1.0:1786400591.416661:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 594: rc = 0 00100000:10000000:1.0:1786400591.417016:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 594: rc = 0 00100000:10000000:1.0:1786400591.417239:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 594: rc = 0 00100000:10000000:1.0:1786400591.417598:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 594: rc = 0 00100000:10000000:1.0:1786400591.417855:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 594: rc = 0 00100000:10000000:1.0:1786400591.418077:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 594: rc = 0 00100000:10000000:1.0:1786400591.418291:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 594: rc = 0 00100000:10000000:1.0:1786400591.418640:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 594: rc = 0 00100000:10000000:1.0:1786400591.418983:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 594: rc = 0 00100000:10000000:1.0:1786400591.419219:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 594: rc = 0 00100000:10000000:1.0:1786400591.419668:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 594: rc = 0 00100000:10000000:1.0:1786400591.426033:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 594: rc = 0 00100000:10000000:1.0:1786400591.426795:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 594: rc = 0 00100000:10000000:1.0:1786400591.427093:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 594: rc = 0 00100000:10000000:1.0:1786400591.427328:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 594: rc = 0 00100000:10000000:1.0:1786400591.427705:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 594: rc = 0 00100000:10000000:1.0:1786400591.428041:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 594: rc = 0 00100000:10000000:1.0:1786400591.428299:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 594: rc = 0 00100000:10000000:1.0:1786400591.428856:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 594: rc = 0 00100000:10000000:1.0:1786400591.429104:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 594: rc = 0 00100000:10000000:1.0:1786400591.429595:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 583: rc = 0 00100000:10000000:1.0:1786400591.430171:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1786400591.430343:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:1.0:1786400591.430672:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1786400591.430731:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:1.0:1786400591.431960:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1786400591.432033:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:1.0:1786400591.432398:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1786400591.433580:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 573: rc = 0 00100000:10000000:1.0:1786400591.434901:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1786400591.434990:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 573: rc = 0 00100000:10000000:1.0:1786400591.435189:0:14193:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1786400591.435260:0:14193:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 573: rc = 0 00000020:00000080:1.0:1786400591.435669:0:14193:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1786400591.435677:0:14193:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1786400591.435688:0:14193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a6101 00000020:01000004:1.0:1786400591.435696:0:14193:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1786400591.435701:0:14193:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1786400591.435706:0:14193:0:(tgt_mount.c:101:server_register_mount()) register mount ffff937399fd8000 from MGS 00000020:01000004:1.0:1786400591.435710:0:14193:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1786400591.435718:0:14193:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9373a0c50000) 00000020:00000080:1.0:1786400591.435727:0:14193:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1786400591.435876:0:14193:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937399fd8000 from MGS, refs=2 00080000:01000000:1.0:1786400591.435881:0:14193:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786400591.435887:0:14193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a610f 00000100:00100000:1.0:1786400591.435982:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1786400591.436105:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1786400591.436112:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1786400591.441479:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1786400591.441492:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1786400591.443413:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400591.443601:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1786400591.443606:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1786400591.444157:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1786400591.444164:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1786400591.447083:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1786400591.447096:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1786400591.447764:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400591.447767:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400591.447769:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400591.448043:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400591.448046:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400591.448048:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400591.448507:0:14193:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1786400591.457141:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1786400591.471232:0:14193:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1786400591.471250:0:14193:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786400591.471253:0:14193:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1786400591.476686:0:14202:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1786400591.476941:0:14193:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1786400591.477052:0:14193:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786400591.477686:0:14193:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1786400591.478022:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400591.480481:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1786400591.480495:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1786400591.485518:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1786400591.485531:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1786400591.500668:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1786400591.500680:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1786400591.502342:0:14193:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1786400591.502370:0:14193:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.123@tcp' 00000020:01000004:3.0:1786400591.502372:0:14193:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1786400591.502412:0:14193:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.123@tcp (typ=mgc) 00000020:00000080:3.0:1786400591.502426:0:14193:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.123@tcp (ffff9373b7b599c0) 00000020:00000080:3.0:1786400591.502445:0:14193:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1786400591.502526:0:14193:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373a0e1a800@MGC192.168.201.123@tcp: add connection 192.168.201.123@tcp at head 00010000:00010000:3.0:1786400591.502869:0:14193:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.123@tcp-0 is initialized 00000040:01000000:3.0:1786400591.502875:0:14193:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 1 is initialized 00000100:00080000:2.0:1786400591.504303:0:14207:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1786400591.504903:0:14208:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1786400591.504974:0:14193:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.123@tcp (uuid 0311c05a-56b5-4d5c-8a54-b3e546b2fc8c) 00000020:00000080:3.0:1786400591.504996:0:14193:0:(genops.c:1406:class_connect()) connect: client 0311c05a-56b5-4d5c-8a54-b3e546b2fc8c, cookie 0x49554f35ff0a611d 00000100:00080000:3.0:1786400591.505006:0:14193:0:(import.c:510:import_select_connection()) MGC192.168.201.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786400591.505012:0:14193:0:(import.c:624:import_select_connection()) MGC192.168.201.123@tcp: import ffff9373a0e1a800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1786400591.505048:0:14193:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93728239dc00 x1873176392983680/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786400591.505077:0:14193:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0311c05a-56b5-4d5c-8a54-b3e546b2fc8c->MGS 00000020:01000004:3.0:1786400591.505102:0:14193:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1786400591.505107:0:14193:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1786400591.505120:0:14193:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9373b7b5cd40) 00000020:00000080:3.0:1786400591.505129:0:14193:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1786400591.506775:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3314:1873176392983680:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1786400591.506855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400591.506924:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392983680 00000100:00100000:2.0:1786400591.506931:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392983680 00000100:00100000:2.0:1786400591.506967:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400591.506973:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3314:x1873176392983680:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1786400591.506998:0:14204:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 0311c05a-56b5-4d5c-8a54-b3e546b2fc8c@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:2.0:1786400591.507022:0:14204:0:(genops.c:1406:class_connect()) connect: client 0311c05a-56b5-4d5c-8a54-b3e546b2fc8c, cookie 0x49554f35ff0a612b 00000100:00080000:2.0:1786400591.507138:0:14204:0:(import.c:65:import_set_state_nolock()) ffff9373b9118000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400591.508704:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+5:3314:x1873176392983680:12345-0@lo:250:mount.lustre.0 Request processed in 1722us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400591.508716:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400591.510510:0:3314:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1786400591.510530:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.123@tcp: connect to target with instance 0 00000100:00080000:1.0:1786400591.510549:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1786400591.510556:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1786400591.510563:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373a0e1a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1786400591.510566:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1786400591.510575:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1786400591.510583:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3314:1873176392983680:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1786400591.527436:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400591.527635:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1786400591.527641:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1786400591.539685:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1786400591.539701:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1786400591.540340:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1786400591.540347:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1786400591.542128:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400591.542281:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1786400591.542285:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1786400591.544794:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1786400591.544807:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1786400591.595112:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400591.595489:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1786400591.595496:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1786400591.596618:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1786400591.596631:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1786400591.597423:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400591.597715:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786400591.597721:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1786400591.598364:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786400591.598373:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1786400591.599219:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400591.599469:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786400591.599475:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1786400591.600073:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786400591.600079:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1786400591.601071:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400591.601361:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786400591.601367:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1786400591.607629:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1786400591.607667:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1786400591.645012:0:14193:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400591.646450:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1786400591.646459:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1786400591.649710:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1786400591.649724:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1786400591.652400:0:14193:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1786400591.653940:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1786400591.660823:0:14193:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1786400591.660850:0:14193:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1786400591.660856:0:14193:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1786400591.660986:0:14193:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786400591.661024:0:14193:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.123@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1786400591.661029:0:14193:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786400591.661031:0:14193:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786400591.661032:0:14193:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400591.661033:0:14193:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400591.661034:0:14193:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400591.661036:0:14193:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400591.661037:0:14193:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786400591.661038:0:14193:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786400591.661040:0:14193:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400591.661041:0:14193:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786400591.661043:0:14193:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1786400591.661045:0:14193:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786400591.661046:0:14193:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786400591.661048:0:14193:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400591.661049:0:14193:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400591.661050:0:14193:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400591.661056:0:14193:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400591.661056:0:14193:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786400591.661057:0:14193:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786400591.661058:0:14193:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400591.661059:0:14193:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786400591.661087:0:14193:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786400591.661108:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392983808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1786400591.661189:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.661241:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937388d84cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400591.661392:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392983808 00000100:00100000:2.0:1786400591.661399:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392983808 00000100:00100000:2.0:1786400591.661449:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400591.661457:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+5:14193:x1873176392983808:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786400591.661502:0:14206:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786400591.661505:0:14206:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1786400591.661508:0:14206:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1786400591.662272:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1786400591.662836:0:14206:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1786400591.673601:0:14228:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1786400591.673610:0:14228:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1786400591.673612:0:14228:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1786400591.673653:0:14228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1786400591.674630:0:14206:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786400591.674642:0:14206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1786400591.689803:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+5:14193:x1873176392983808:12345-0@lo:253:mount.lustre.0 Request processed in 28337us (28604us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400591.689854:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786400591.689976:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392983808:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786400591.689990:0:14193:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1786400591.689993:0:14193:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786400591.689995:0:14193:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786400591.690011:0:14193:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400591.690013:0:14193:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400591.690014:0:14193:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400591.690015:0:14193:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400591.690017:0:14193:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786400591.690018:0:14193:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786400591.690020:0:14193:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400591.690021:0:14193:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786400591.690040:0:14193:0:(tgt_mount.c:101:server_register_mount()) register mount ffff937399fd8000 from lustre-MDT0000 10000000:01000000:0.0:1786400591.690065:0:14193:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1786400591.690068:0:14193:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1786400591.690073:0:14193:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9373b7b599c0 10000000:01000000:0.0:1786400591.690077:0:14193:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786400591.690085:0:14193:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9373b7b599c0 from 1 10000000:01000000:0.0:1786400591.690088:0:14193:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786400591.690125:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.690149:0:14193:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.690160:0:14193:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400591.690179:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392983936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786400591.690215:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400591.690397:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392983936 00000100:00100000:2.0:1786400591.690404:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392983936 00000100:00100000:2.0:1786400591.690453:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400591.690463:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+5:14193:x1873176392983936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786400591.690485:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400591.690501:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b7a1e200/0x49554f35ff0a6139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a6132 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400591.690524:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b7a1e200/0x49554f35ff0a6139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a6132 expref: 6 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400591.690534:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b7a1e200/0x49554f35ff0a6139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6132 expref: 6 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400591.690548:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e200, rc 0) 00000100:00100000:0.0:1786400591.690582:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937398688cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400591.690591:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+6:14193:x1873176392983936:12345-0@lo:101:mount.lustre.0 Request processed in 130us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.690594:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392983936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786400591.690597:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1786400591.690606:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.690615:0:14193:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400591.690667:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400591.690692:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400591.690718:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937398688cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400591.690825:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392984064 00000100:00100000:3.0:1786400591.690830:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392984064 00000100:00100000:3.0:1786400591.690857:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400591.690923:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+6:14193:x1873176392984064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400591.691143:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+6:14193:x1873176392984064:12345-0@lo:501:mount.lustre.0 Request processed in 279us (449us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786400591.691150:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786400591.691463:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984064:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1786400591.691492:0:14193:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786400591.691522:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400591.691532:0:14193:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400591.691541:0:14193:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff937399fd8000 10000000:01000000:1.0:1786400591.691545:0:14193:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786400591.691550:0:14193:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff937399fd8000 10000000:01000000:1.0:1786400591.691552:0:14193:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1786400591.691555:0:14193:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff937399fd8000 from 1 10000000:01000000:1.0:1786400591.691557:0:14193:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1786400591.691579:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf800/0x49554f35ff0a6140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400591.691587:0:14193:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373bfebf800/0x49554f35ff0a6140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400591.691594:0:14193:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373bfebf800/0x49554f35ff0a6140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400591.691615:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786400591.691645:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400591.691667:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7366f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786400591.692129:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392984192 00000100:00100000:3.0:1786400591.692134:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392984192 00000100:00100000:3.0:1786400591.692161:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400591.692167:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+6:14193:x1873176392984192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786400591.692177:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400591.692192:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399762600/0x49554f35ff0a6147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a6140 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.692224:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399762600/0x49554f35ff0a6147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a6140 expref: 7 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.692233:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399762600/0x49554f35ff0a6147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6140 expref: 7 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.692241:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762600, rc 0) 00000100:00100000:3.0:1786400591.692273:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+7:14193:x1873176392984192:12345-0@lo:101:mount.lustre.0 Request processed in 106us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400591.692279:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400591.693829:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786400591.693852:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373bfebf800/0x49554f35ff0a6140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6147 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400591.693864:0:14193:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373bfebf800/0x49554f35ff0a6140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6147 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400591.693883:0:14193:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1786400591.693895:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebf800/0x49554f35ff0a6140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6147 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400591.693902:0:14193:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373bfebf800/0x49554f35ff0a6140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6147 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400591.693910:0:14193:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1786400591.693917:0:14193:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786400591.693922:0:14193:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff937399fd8000 10000000:01000000:1.0:1786400591.693925:0:14193:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1786400591.693929:0:14193:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1786400591.693932:0:14193:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786400591.693956:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebfe00/0x49554f35ff0a614e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400591.693964:0:14193:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373bfebfe00/0x49554f35ff0a614e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400591.693989:0:14193:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373bfebfe00/0x49554f35ff0a614e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400591.694009:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786400591.694058:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400591.694092:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7366f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.695760:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392984320 00000100:00100000:0.0:1786400591.695771:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392984320 00000100:00100000:0.0:1786400591.695847:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786400591.695857:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+7:14193:x1873176392984320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400591.695873:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400591.695890:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f48c00/0x49554f35ff0a6155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a614e expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.695914:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f48c00/0x49554f35ff0a6155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a614e expref: 8 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.695925:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f48c00/0x49554f35ff0a6155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a614e expref: 8 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.695935:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48c00, rc 0) 00000100:00100000:0.0:1786400591.696003:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+8:14193:x1873176392984320:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.696011:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400591.696341:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786400591.696374:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373bfebfe00/0x49554f35ff0a614e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6155 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400591.696385:0:14193:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373bfebfe00/0x49554f35ff0a614e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6155 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400591.696459:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0517480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786400591.696493:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400591.696678:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff93739125c180 going to sleep for 11 seconds 00000100:00100000:3.0:1786400591.697635:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392984448 00000100:00100000:3.0:1786400591.697643:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392984448 00000100:00100000:3.0:1786400591.697693:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400591.697701:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+8:14193:x1873176392984448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400591.698136:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+9:14193:x1873176392984448:12345-0@lo:501:mount.lustre.0 Request processed in 435us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400591.698144:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400591.699334:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0517480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786400591.699413:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786400591.699466:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400591.699498:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7366600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400591.699728:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392984576 00000100:00100000:3.0:1786400591.699733:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392984576 00000100:00100000:3.0:1786400591.699793:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400591.699801:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+9:14193:x1873176392984576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786400591.700133:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+9:14193:x1873176392984576:12345-0@lo:503:mount.lustre.0 Request processed in 332us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400591.700141:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400591.700259:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392984576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786400591.707333:0:14229:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14229:1873176392984704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400591.707437:0:14229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400591.707481:0:14229:0:(client.c:2702:ptlrpc_set_wait()) set ffff937381254480 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.707621:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392984704 00000100:00100000:0.0:1786400591.707628:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392984704 00000100:00100000:0.0:1786400591.707677:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786400591.707686:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+9:14229:x1873176392984704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400591.708024:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+9:14229:x1873176392984704:12345-0@lo:502:llog_process_th.0 Request processed in 338us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.708037:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400591.708166:0:14229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14229:1873176392984704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786400591.708192:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400591.708202:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400591.708204:0:14229:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1786400591.708211:0:14229:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1786400591.708214:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786400591.708227:0:14229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9373b91eb380) 00000020:00000080:2.0:1786400591.708245:0:14229:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1786400591.708256:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1786400591.708312:0:14229:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1786400591.708318:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a6163 00000020:00000080:2.0:1786400591.708567:0:14229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1786400591.708572:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400591.708576:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400591.708577:0:14229:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1786400591.708580:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400591.708584:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400591.708585:0:14229:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1786400591.708589:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786400591.708594:0:14229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9373b91e8000) 00000020:00000080:2.0:1786400591.708604:0:14229:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1786400591.708607:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1786400591.708609:0:14229:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1786400591.708612:0:14229:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1786400591.708617:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1786400591.708651:0:14229:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937399fd8000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1786400591.708661:0:14229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9373b91ecd40) 00000020:00000080:2.0:1786400591.708669:0:14229:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1786400591.708707:0:14229:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1786400591.708711:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a6178 00000020:00000080:2.0:1786400591.708843:0:14229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1786400591.708848:0:14229:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1786400591.708853:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x49554f35ff0a617f 00080000:01000000:2.0:1786400591.708857:0:14229:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1786400591.708861:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a6186 00010000:00010000:0.0:1786400591.806665:0:14229:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1786400591.808123:0:14229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1786400591.808822:0:14229:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1786400591.809346:0:14229:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9373b9c03380) 00000020:00000080:0.0:1786400591.809365:0:14229:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1786400591.809431:0:14229:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1786400591.809438:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a6194 00000020:00000080:0.0:1786400591.809972:0:14229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1786400591.821691:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x49554f35ff0a619b 00000020:00000080:3.0:1786400591.823627:0:14229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1786400591.823640:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400591.823654:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.823666:0:14229:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1786400591.823671:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786400591.823673:0:14229:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1786400591.823675:0:14229:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786400591.823676:0:14229:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786400591.823678:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786400591.823680:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.823682:0:14229:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786400591.823684:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400591.823689:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.823690:0:14229:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1786400591.823694:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1786400591.823736:0:14229:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1786400591.823777:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400591.823780:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.823781:0:14229:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1786400591.823783:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786400591.823786:0:14229:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1786400591.823789:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.823790:0:14229:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1786400591.823792:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786400591.823797:0:14229:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.123@tcp to nid 0x20000c0a8c97b (192.168.201.123@tcp) 00000020:01000000:3.0:1786400591.823829:0:14229:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786400591.823832:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786400591.823847:0:14229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9373b7b58000) 00000020:00000080:3.0:1786400591.823863:0:14229:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1786400591.823868:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786400591.823921:0:14229:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1786400591.823928:0:14229:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1786400591.823933:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a61a9 00010000:00080000:3.0:1786400591.823979:0:14229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373b7355800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:3.0:1786400591.824213:0:14229:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1786400591.827053:0:14229:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1786400591.827102:0:14229:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1786400591.828484:0:14229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400591.828820:0:14229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1786400591.828888:0:14229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1786400591.829733:0:14233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1786400591.829759:0:14233:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1786400591.831252:0:14229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786400591.831270:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786400591.831381:0:14229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1786400591.831482:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a61b0 00000100:00080000:1.0:1786400591.831492:0:14229:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786400591.831498:0:14229:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9373b7355800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1786400591.831606:0:14229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b7723100 x1873176392984832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786400591.831774:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392984832:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1786400591.831846:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873176392984832 offset 0 length 520: 4 00000100:00080000:1.0:1786400591.831969:0:14229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1786400591.832039:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400591.832044:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400591.832046:0:14229:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1786400591.832049:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786400591.832052:0:14229:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1786400591.832063:0:14229:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786400591.832065:0:14229:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786400591.832066:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786400591.832069:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400591.832070:0:14229:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786400591.832073:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786400591.832077:0:14229:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1786400591.832080:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400591.832081:0:14229:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1786400591.832084:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786400591.832088:0:14229:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.123@tcp to nid 0x20000c0a8c97b (192.168.201.123@tcp) 00000020:01000000:1.0:1786400591.832111:0:14229:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1786400591.832114:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786400591.832127:0:14229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9373a0c54d40) 00000020:00000080:1.0:1786400591.832140:0:14229:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1786400591.832145:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786400591.832202:0:14229:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1786400591.832208:0:14229:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1786400591.832213:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49554f35ff0a61be 00010000:00080000:1.0:1786400591.832242:0:14229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937386eec800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:1.0:1786400591.832894:0:14229:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1786400591.833084:0:14229:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1786400591.833109:0:14229:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1786400591.834136:0:14229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786400591.834206:0:14229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1786400591.834290:0:14229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1786400591.835358:0:14235:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1786400591.835364:0:14235:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1786400591.836497:0:14229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786400591.836578:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786400591.836626:0:14229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1786400591.836647:0:14229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a61c5 00000100:00080000:1.0:1786400591.836724:0:14229:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786400591.836733:0:14229:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937386eec800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1786400591.836850:0:14229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b7722a00 x1873176392984960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786400591.836876:0:14229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1786400591.836966:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400591.836971:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400591.836973:0:14229:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1786400591.836975:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400591.836979:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400591.836981:0:14229:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786400591.836984:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786400591.836985:0:14229:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786400591.836987:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400591.836989:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400591.836990:0:14229:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1786400591.836992:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400591.836995:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400591.836996:0:14229:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786400591.837000:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1786400591.837032:0:14229:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14229:1873176392985088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400591.837105:0:14229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400591.837141:0:14229:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7366e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400591.837327:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392984960:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1786400591.837358:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873176392984960 offset 0 length 520: 4 00000100:00100000:2.0:1786400591.838127:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392985088 00000100:00100000:2.0:1786400591.838136:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392985088 00000100:00100000:2.0:1786400591.838219:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400591.838229:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+9:14229:x1873176392985088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400591.838638:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+9:14229:x1873176392985088:12345-0@lo:502:llog_process_th.0 Request processed in 287us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400591.838647:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786400591.838909:0:14229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14229:1873176392985088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400591.838940:0:14229:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400591.838947:0:14229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400591.838949:0:14229:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786400591.838954:0:14229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1786400591.839103:0:14193:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1786400591.839123:0:14193:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1786400591.839140:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebfe00/0x49554f35ff0a614e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6155 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.839151:0:14193:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373bfebfe00/0x49554f35ff0a614e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6155 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400591.839160:0:14193:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff937399fd8000 from 1 10000000:01000000:3.0:1786400591.839163:0:14193:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786400591.839195:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.839203:0:14193:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.839213:0:14193:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400591.839230:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786400591.839263:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.839462:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.839668:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392985216 00000100:00100000:0.0:1786400591.839673:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392985216 00000100:00100000:0.0:1786400591.839699:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786400591.839707:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+9:14193:x1873176392985216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400591.839717:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400591.839730:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a61cc expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.839765:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 10 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.839776:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 10 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.839785:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49000, rc 0) 00000100:00100000:0.0:1786400591.839838:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+10:14193:x1873176392985216:12345-0@lo:101:mount.lustre.0 Request processed in 131us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.839850:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786400591.839985:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786400591.839997:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.840005:0:14193:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400591.840856:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985344:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1786400591.840913:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.840948:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.841364:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392985344 00000100:00100000:0.0:1786400591.841370:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392985344 00000100:00100000:0.0:1786400591.841574:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400591.841584:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+10:14193:x1873176392985344:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1786400591.841601:0:14203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1786400591.841607:0:14203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1786400591.841696:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+10:14193:x1873176392985344:12345-0@lo:256:mount.lustre.0 Request processed in 114us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.841703:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786400591.841939:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985344:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1786400591.842858:0:14193:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786400591.842880:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.842892:0:14193:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400591.842901:0:14193:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff937399fd8000 from 1 10000000:01000000:3.0:1786400591.842903:0:14193:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400591.842935:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.842944:0:14193:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.842954:0:14193:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400591.842988:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786400591.843032:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.843075:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.843210:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392985472 00000100:00100000:0.0:1786400591.843216:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392985472 00000100:00100000:0.0:1786400591.843259:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786400591.843266:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+10:14193:x1873176392985472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400591.843278:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400591.843292:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a61da expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.843322:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a61da expref: 11 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.843333:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a61da expref: 11 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.843340:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48400, rc 0) 00000100:00100000:0.0:1786400591.843379:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14193:x1873176392985472:12345-0@lo:101:mount.lustre.0 Request processed in 113us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.843384:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400591.843827:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786400591.843842:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.843851:0:14193:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400591.843901:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400591.843932:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.843992:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba300 going to sleep for 11 seconds 00000100:00100000:1.0:1786400591.844102:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392985600 00000100:00100000:1.0:1786400591.844107:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392985600 00000100:00100000:2.0:1786400591.844151:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400591.844160:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14193:x1873176392985600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786400591.844731:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14193:x1873176392985600:12345-0@lo:501:mount.lustre.0 Request processed in 570us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400591.844875:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786400591.844958:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400591.844992:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786400591.845031:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.845058:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400591.845106:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392985728 00000100:00100000:2.0:1786400591.845110:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392985728 00000100:00100000:2.0:1786400591.845143:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786400591.845150:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14193:x1873176392985728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786400591.845297:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14193:x1873176392985728:12345-0@lo:503:mount.lustre.0 Request processed in 146us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400591.845304:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786400591.845503:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392985728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786400591.846107:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14237:1873176392985856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400591.846145:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.846175:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fbac00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.846225:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392985856 00000100:00100000:0.0:1786400591.846230:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392985856 00000100:00100000:0.0:1786400591.846262:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400591.846270:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14237:x1873176392985856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400591.846865:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14237:x1873176392985856:12345-0@lo:502:llog_process_th.0 Request processed in 595us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.846873:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786400591.847008:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14237:1873176392985856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786400591.847032:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400591.847046:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.847048:0:14237:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1786400591.847055:0:14237:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff937399fd8000 00000020:00000080:3.0:1786400591.847058:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1786400591.847064:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400591.847067:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.847068:0:14237:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1786400591.847070:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400591.847072:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.847074:0:14237:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1786400591.847077:0:14237:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff937399fd8000 00000020:00000080:3.0:1786400591.847079:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1786400591.847168:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400591.847172:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.847173:0:14237:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1786400591.847175:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400591.847178:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.847179:0:14237:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1786400591.847182:0:14237:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff937399fd8000 00000020:00000080:3.0:1786400591.847184:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786400591.858120:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14237:1873176392985984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400591.858204:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.858248:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392985984 00000100:00100000:3.0:1786400591.858254:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392985984 00000100:00100000:3.0:1786400591.858296:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400591.858316:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14237:x1873176392985984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400591.858533:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14237:x1873176392985984:12345-0@lo:502:llog_process_th.0 Request processed in 229us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400591.858540:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400591.858591:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fbac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786400591.858612:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14237:1873176392985984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786400591.858647:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400591.858655:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400591.858657:0:14237:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1786400591.858661:0:14237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1786400591.865059:0:14193:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1786400591.865091:0:14193:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786400591.865117:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.865131:0:14193:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400591.865185:0:14193:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1786400591.865188:0:14193:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff937399fd8000 10000000:01000000:0.0:1786400591.865191:0:14193:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff937399fd8000 10000000:01000000:0.0:1786400591.865195:0:14193:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786400591.865201:0:14193:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff937399fd8000 from 1 10000000:01000000:0.0:1786400591.865204:0:14193:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786400591.865242:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49c00/0x49554f35ff0a61e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.865258:0:14193:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b8f49c00/0x49554f35ff0a61e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.865269:0:14193:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b8f49c00/0x49554f35ff0a61e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400591.865305:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392986112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786400591.865369:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400591.865394:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fd0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.868007:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392986112 00000100:00100000:0.0:1786400591.868017:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392986112 00000100:00100000:0.0:1786400591.868077:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786400591.868085:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14193:x1873176392986112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400591.868100:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400591.868118:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f49400/0x49554f35ff0a61ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a61e8 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.868143:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f49400/0x49554f35ff0a61ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a61e8 expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.868153:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f49400/0x49554f35ff0a61ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a61e8 expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.868162:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49400, rc 0) 00000100:00100000:0.0:1786400591.868230:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14193:x1873176392986112:12345-0@lo:101:mount.lustre.0 Request processed in 144us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.868237:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786400591.868293:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392986112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400591.868379:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b8f49c00/0x49554f35ff0a61e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61ef expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.868390:0:14193:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b8f49c00/0x49554f35ff0a61e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a61ef expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400591.868774:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392986240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400591.868823:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400591.868845:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fd0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400591.871459:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392986240 00000100:00100000:3.0:1786400591.871470:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392986240 00000100:00100000:3.0:1786400591.871652:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786400591.871662:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14193:x1873176392986240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400591.871998:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14193:x1873176392986240:12345-0@lo:501:mount.lustre.0 Request processed in 337us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400591.872007:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786400591.877983:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392986240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400591.878044:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392986368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786400591.878118:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400591.878162:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fd0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400591.880245:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392986368 00000100:00100000:2.0:1786400591.880268:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392986368 00000100:00100000:2.0:1786400591.880460:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786400591.880474:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14193:x1873176392986368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786400591.880815:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14193:x1873176392986368:12345-0@lo:503:mount.lustre.0 Request processed in 331us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400591.880824:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786400591.887186:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392986368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786400591.898074:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14242:1873176392986496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400591.898171:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400591.898216:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373812ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.898281:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392986496 00000100:00100000:0.0:1786400591.898290:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392986496 00000100:00100000:0.0:1786400591.898481:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786400591.898491:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14242:x1873176392986496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400591.899837:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14242:x1873176392986496:12345-0@lo:502:llog_process_th.0 Request processed in 1342us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400591.899848:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786400591.903726:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14242:1873176392986496:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1786400591.903910:0:14242:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1786400591.903943:0:14242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9373c1d38000) 00000020:00000080:3.0:1786400591.903967:0:14242:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1786400591.904142:0:14242:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937399fd8000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786400591.904146:0:14242:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937399fd8000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786400591.904149:0:14242:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937399fd8000 4 00010000:00080000:3.0:1786400591.904175:0:14242:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373b9c2a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:2.0:1786400591.909800:0:14242:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1786400591.910658:0:14242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1786400591.910704:0:14242:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1786400591.910724:0:14242:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x49554f35ff0a61fd 00000100:00080000:2.0:1786400591.910735:0:14242:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786400591.910769:0:14242:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9373b9c2a000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1786400591.910824:0:14242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b0514380 x1873176392986624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786400591.910851:0:14242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786400591.911136:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392986624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786400591.911210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400591.911277:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392986624 00000100:00100000:2.0:1786400591.911285:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392986624 00000100:00100000:2.0:1786400591.911315:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400591.911330:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1873176392986624:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786400591.911385:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1873176392986624:12345-0@lo:38:llog_process_th.0 Request processed in 54us (174us total) trans 0 rc -11/-11 00000100:00100000:2.0:1786400591.911392:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400591.912719:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786400591.912731:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b9c2a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786400591.912782:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1786400591.912788:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392986624:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786400591.914366:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14242:1873176392986752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400591.914447:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400591.914486:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392986752 00000100:00100000:2.0:1786400591.914492:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392986752 00000100:00100000:2.0:1786400591.914816:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786400591.914826:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14242:x1873176392986752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400591.916940:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14242:x1873176392986752:12345-0@lo:502:llog_process_th.0 Request processed in 2106us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400591.917581:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786400591.917668:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fd0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400591.917695:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14242:1873176392986752:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786400591.917731:0:14242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1786400591.922887:0:14193:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1786400591.922926:0:14193:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786400591.922950:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49c00/0x49554f35ff0a61e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61ef expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400591.922963:0:14193:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b8f49c00/0x49554f35ff0a61e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a61ef expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786400591.923027:0:14193:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786400591.923029:0:14193:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786400591.923031:0:14193:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400591.923032:0:14193:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400591.923039:0:14193:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400591.923040:0:14193:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400591.923041:0:14193:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786400591.923043:0:14193:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786400591.923044:0:14193:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400591.923046:0:14193:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786400591.923049:0:14193:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1786400591.923051:0:14193:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786400591.923052:0:14193:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786400591.923053:0:14193:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400591.923054:0:14193:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400591.923055:0:14193:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400591.923056:0:14193:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400591.923057:0:14193:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786400591.923058:0:14193:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786400591.923059:0:14193:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400591.923060:0:14193:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786400591.923090:0:14193:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1786400591.923111:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392986880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786400591.923179:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400591.923216:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373908a3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400591.923261:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392986880 00000100:00100000:0.0:1786400591.923268:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392986880 00000100:00100000:0.0:1786400591.924697:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786400591.924715:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14193:x1873176392986880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786400591.924781:0:14203:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786400591.924796:0:14203:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786400591.998364:0:14203:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786400591.998381:0:14203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1786400591.998757:0:14227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786400591.998762:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786400591.998785:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400591.998813:0:14227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400591.998822:0:14227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400591.998865:0:14227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400591.998879:0:14227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 12 pid: 14203 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400591.998894:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14227:1873176392987008:0@lo:104: 00000100:00100000:2.0:1786400591.999023:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400591.999070:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738407e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400591.999238:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392987008 00000100:00100000:3.0:1786400591.999246:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392987008 00000100:00100000:3.0:1786400591.999294:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786400591.999302:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0517800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:14227:x1873176392987008:12345-0@lo:104: 00010000:00010000:3.0:1786400591.999314:0:14194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999369:0:14194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400591.999387:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0517800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:14227:x1873176392987008:12345-0@lo:104: Request processed in 86us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400591.999394:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1786400591.999413:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400591.999419:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999427:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400591.999431:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999439:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400591.999446:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400591.999452:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786400591.999479:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999485:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400591.999504:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999522:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a61cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a61d3 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999540:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400591.999542:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400591.999544:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400591.999578:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3318:1873176392987136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400591.999607:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400591.999659:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392987136 00000100:00100000:3.0:1786400591.999663:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392987136 00010000:00010000:3.0:1786400591.999679:0:14196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 13 pid: 14203 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400591.999701:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786400591.999707:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+13:3318:x1873176392987136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400591.999717:0:14196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400591.999722:0:14196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 13 pid: 14203 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999732:0:14196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 13 pid: 14203 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999786:0:14196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999794:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786400591.999818:0:14196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001056899s 00010000:00010000:3.0:1786400591.999823:0:14196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999830:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999836:0:14196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999852:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999866:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e000 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:3.0:1786400591.999870:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999878:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999887:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400591.999897:0:14196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400591.999926:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+13:3318:x1873176392987136:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400591.999932:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1786400592.000224:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a61d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a61cc expref: 12 pid: 14203 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400592.000234:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14227:1873176392987008:0@lo:104: 00010000:00010000:0.0:1786400592.000250:0:14227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400592.000265:0:14227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400592.000271:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400592.000277:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b7a1e000/0x49554f35ff0a6204 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400592.001400:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3318:1873176392987136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400592.044728:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14193:x1873176392986880:12345-0@lo:253:mount.lustre.0 Request processed in 120012us (121540us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400592.044765:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786400592.045129:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14193:1873176392986880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786400592.045145:0:14193:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1786400592.045148:0:14193:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786400592.045150:0:14193:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786400592.045151:0:14193:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400592.045152:0:14193:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400592.045154:0:14193:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400592.045155:0:14193:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400592.045157:0:14193:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786400592.045158:0:14193:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786400592.045160:0:14193:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400592.045161:0:14193:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1786400592.045178:0:14193:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1786400592.067274:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400592.067438:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1786400592.068075:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400592.068234:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1786400592.068491:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400592.069188:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400592.072430:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400592.072695:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400592.073234:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400592.073460:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400592.075829:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400592.076146:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1786400592.204175:0:14193:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1786400592.205133:0:14193:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1786400592.206336:0:14251:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1786400592.206426:0:14251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1786400592.212687:0:14193:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1786400592.212846:0:14193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400592.213640:0:14251:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1786400592.213706:0:14251:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1786400592.213711:0:14251:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:0.0:1786400592.215126:0:14250:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1786400592.215132:0:14250:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:2.0:1786400592.217096:0:14193:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1786400592.217217:0:14193:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1786400592.218039:0:14193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400592.221141:0:14193:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1786400592.223081:0:14193:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1786400592.223144:0:14193:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1786400592.230663:0:14193:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1786400592.249286:0:14193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1786400592.362937:0:14193:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1786400592.363085:0:14193:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4bd81cc7988 00100000:10000000:3.0:1786400592.363094:0:14193:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1786400592.368220:0:14193:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1786400592.368241:0:14193:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1786400592.368257:0:14193:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1786400592.368287:0:14193:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1786400592.467132:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786400592.598176:0:14208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786400592.598185:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff937399fd8000 from 6 10000000:01000000:3.0:1786400592.598191:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786400592.598237:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400592.598251:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400592.598264:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400592.598291:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392987264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786400592.598367:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400592.598427:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b78716c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400592.598481:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392987264 00000100:00100000:0.0:1786400592.598489:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392987264 00000100:00100000:0.0:1786400592.598546:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786400592.598556:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14208:x1873176392987264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400592.598581:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400592.598595:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a620b expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400592.598618:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a620b expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400592.598627:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a620b expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400592.598636:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49000, rc 0) 00000100:00100000:0.0:1786400592.598680:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14208:x1873176392987264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400592.598687:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786400592.598808:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392987264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400592.598831:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400592.598839:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400592.598901:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392987392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786400592.598933:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400592.598961:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b78716c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400592.599247:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392987392 00000100:00100000:0.0:1786400592.599252:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392987392 00000100:00100000:0.0:1786400592.599286:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786400592.599294:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14208:x1873176392987392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786400592.599309:0:14203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786400592.599328:0:14203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786400592.599332:0:14203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1786400592.599404:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14208:x1873176392987392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400592.599412:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400592.601028:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392987392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786400592.601118:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786400592.601129:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400592.601138:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786400592.919598:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1786400593.490944:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786400593.941246:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1786400594.516260:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400595.539961:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400596.576199:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400597.368287:0:14494:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1786400597.396087:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786400597.396094:0:10440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786400597.396097:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786400597.396100:0:10440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786400597.396102:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1786400597.396105:0:10440:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786400597.396110:0:10440:0:(import.c:65:import_set_state_nolock()) ffff9373b9c2a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786400597.396121:0:10440:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9373b9c2a000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1786400597.396143:0:10440:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b7720700 x1873176392987648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786400597.396187:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400597.396197:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3316:1873176392987520:0@lo:400:kworker.0 00000100:00100000:1.0:1786400597.396267:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400597.396328:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392987520 00000100:00100000:1.0:1786400597.396335:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392987520 00000100:00100000:1.0:1786400597.396379:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786400597.396387:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:3316:x1873176392987520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400597.396437:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:3316:x1873176392987520:12345-0@lo:400:kworker.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400597.396445:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786400597.396490:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3316:1873176392987520:0@lo:400:kworker.0 00000100:00100000:2.0:1786400597.396641:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392987648:0@lo:38:kworker.0 00000100:00100000:2.0:1786400597.396674:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400597.396965:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392987648 00000100:00100000:1.0:1786400597.396980:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392987648 00000100:00100000:1.0:1786400597.397051:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400597.397057:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1873176392987648:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1786400597.397080:0:14213:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1786400597.397115:0:14213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x49554f35ff0a6219 00000004:00100000:1.0:1786400597.397129:0:14213:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786400597.397292:0:14213:0:(import.c:65:import_set_state_nolock()) ffff9373b04b7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400597.397339:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873176392987648:12345-0@lo:38:kworker.0 Request processed in 282us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400597.397346:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786400597.399841:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9373b7720700 x1873176392987648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786400597.399862:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1786400597.399872:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1786400597.399878:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786400597.399881:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b9c2a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786400597.399895:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873176392987648:0@lo:38:kworker.0 00010000:00010000:0.0:1786400597.591423:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400598.611202:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400599.636004:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400600.659476:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786400600.686451:0:14646:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd734c66f0 00000020:00000080:2.0:1786400600.686469:0:14646:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1786400600.686473:0:14646:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1786400600.686481:0:14646:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd734c8980 20000000:00000080:2.0:1786400600.686488:0:14646:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9373b7380400 uarg=0000000000000000 20000000:01000000:2.0:1786400600.686523:0:14646:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1786400600.686530:0:14646:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1786400600.686535:0:14646:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1786400600.687598:0:14647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1786400600.688038:0:14646:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1786400600.693396:0:14646:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786400600.693430:0:14646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400600.693450:0:14646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a61da expref: 11 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400600.693458:0:14646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400600.693513:0:14646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a61da expref: 11 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400600.693528:0:14646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a61da expref: 11 pid: 14203 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400600.693542:0:14646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14646:1873176392987776:0@lo:104: 00000100:00100000:2.0:1786400600.693604:0:14646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400600.693723:0:14646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400600.694437:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392987776 00000100:00100000:2.0:1786400600.694445:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392987776 00000100:00100000:2.0:1786400600.694531:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400600.694540:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:14646:x1873176392987776:12345-0@lo:104: 00010000:00010000:2.0:1786400600.694557:0:14195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400600.694658:0:14195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786400600.694666:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:14646:x1873176392987776:12345-0@lo:104: Request processed in 126us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400600.694672:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1786400600.694725:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400600.694733:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.694759:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763800 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:3.0:1786400600.694763:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.694772:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400600.694780:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400600.694785:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786400600.694819:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.694826:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786400600.694959:0:14646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14646:1873176392987776:0@lo:104: 00010000:00010000:1.0:1786400600.694980:0:14646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695197:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695206:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399763800/0x49554f35ff0a61da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a61e1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695221:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400600.695223:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400600.695225:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400600.695233:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400600.695252:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176392987904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400600.695288:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400600.695327:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392987904 00000100:00100000:3.0:1786400600.695331:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392987904 00010000:00010000:3.0:1786400600.695351:0:14196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a61da expref: 12 pid: 14203 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400600.695372:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400600.695379:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:3315:x1873176392987904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400600.695389:0:14196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400600.695394:0:14196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a61da expref: 12 pid: 14203 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695404:0:14196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a61da expref: 12 pid: 14203 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695417:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a61e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a61da expref: 12 pid: 14203 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695428:0:14196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695436:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695449:0:14196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695455:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695471:0:14196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695477:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695483:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ec00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:3.0:1786400600.695487:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695494:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695505:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400600.695513:0:14196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400600.695543:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:3315:x1873176392987904:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400600.695550:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400600.695579:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176392987904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400600.695632:0:14646:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400600.695640:0:14646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400600.695646:0:14646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b7a1ec00/0x49554f35ff0a6220 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400601.490934:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400591/real 1786400591] req@ffff9373b7722a00 x1873176392984960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786400601 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400601.490980:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9373b7722a00 x1873176392984960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786400601 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400601.491035:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400591/real 1786400591] req@ffff9373b7723100 x1873176392984832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786400601 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400601.491078:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9373b7723100 x1873176392984832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786400601 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786400601.491098:0:3314:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786400601.491124:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1786400601.491128:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392984960:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1786400601.491134:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b7355800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786400601.491140:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1786400601.491143:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392984832:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1786400601.491332:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786400601.491337:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786400601.491340:0:38:0:(import.c:65:import_set_state_nolock()) ffff9373b7355800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786400601.491345:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1786400601.491350:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786400601.491356:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9373b7355800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1786400601.491378:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b0517100 x1873176392988160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786400601.491408:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786400601.491411:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1786400601.491413:0:38:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786400601.491417:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1786400601.491419:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786400601.491423:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937386eec800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1786400601.491436:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b0514700 x1873176392988288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786400601.491515:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392988160:0@lo:8:kworker.0 00000400:00000100:1.0:1786400601.491568:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873176392988160 offset 0 length 520: 4 00000100:00100000:1.0:1786400601.491612:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392988288:0@lo:8:kworker.0 00000400:00000100:1.0:1786400601.491664:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873176392988288 offset 0 length 520: 4 00000100:00100000:3.0:1786400601.491944:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3317:1873176392988032:0@lo:400:kworker.0 00000100:00100000:3.0:1786400601.491995:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400601.492026:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400601.492032:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392988416:0@lo:400:kworker.0 00000100:00100000:3.0:1786400601.492057:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400601.492197:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392988416 00000100:00100000:2.0:1786400601.492205:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392988416 00000100:00100000:2.0:1786400601.492254:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400601.492264:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392988416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400601.492320:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392988416:12345-0@lo:400:kworker.0 Request processed in 57us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400601.492327:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786400601.492364:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9373b0514a80 x1873176392988416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400601.492376:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392988416:0@lo:400:kworker.0 00000100:00100000:1.0:1786400601.492446:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392988032 00000100:00100000:1.0:1786400601.492450:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392988032 00000100:00100000:1.0:1786400601.492487:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786400601.492494:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:3317:x1873176392988032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400601.492526:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:3317:x1873176392988032:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400601.492533:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786400601.492615:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3317:1873176392988032:0@lo:400:kworker.0 00010000:00010000:1.0:1786400601.696600:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786400602.258845:0:14208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786400602.258870:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff937399fd8000 from 10 10000000:01000000:0.0:1786400602.258875:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400602.258926:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400602.258938:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400602.258949:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400602.258974:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392988544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400602.259049:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400602.259101:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a0f3bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400602.259328:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392988544 00000100:00100000:3.0:1786400602.259336:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392988544 00000100:00100000:3.0:1786400602.259391:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400602.259402:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+11:14208:x1873176392988544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400602.259417:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400602.259432:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a6227 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400602.259455:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400602.259465:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400602.259482:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763800, rc 0) 00000100:00100000:3.0:1786400602.259521:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14208:x1873176392988544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400602.259528:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786400602.259961:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392988544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400602.259977:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400602.259986:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400602.260039:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392988672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400602.260066:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400602.260098:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a0f3bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400602.260150:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392988672 00000100:00100000:3.0:1786400602.260156:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392988672 00000100:00100000:3.0:1786400602.260187:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786400602.260194:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14208:x1873176392988672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400602.260447:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14208:x1873176392988672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400602.260455:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786400602.260591:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392988672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400602.260618:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392988800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400602.260665:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400602.260693:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a0f3bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400602.260877:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392988800 00000100:00100000:3.0:1786400602.260882:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392988800 00000100:00100000:3.0:1786400602.260904:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786400602.260910:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14208:x1873176392988800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400602.261054:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14208:x1873176392988800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400602.261060:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786400602.261185:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392988800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786400602.262238:0:14704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1786400602.262446:0:14208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1786400602.262462:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400602.262474:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400602.262483:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400602.716959:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786400603.156346:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786400603.731098:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400604.754912:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786400605.214178:0:14847:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786400605.214184:0:14847:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1786400605.214355:0:14847:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9373b8908800 00000020:01000004:3.0:1786400605.214378:0:14847:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1786400605.214396:0:14847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1786400605.214416:0:14847:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9373c1d3cd40) 00000020:00000080:3.0:1786400605.214439:0:14847:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786400605.293711:0:14847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786400605.294101:0:14847:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1786400605.303520:0:14847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1786400605.306531:0:14847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1786400605.307674:0:14847:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1786400605.309175:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 645: rc = 0 00100000:10000000:2.0:1786400605.309320:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 645: rc = 0 00100000:10000000:2.0:1786400605.309418:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 645: rc = 0 00100000:10000000:2.0:1786400605.318318:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 734: rc = 0 00100000:10000000:0.0:1786400605.321551:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 734: rc = 0 00100000:10000000:0.0:1786400605.322305:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 734: rc = 0 00100000:10000000:0.0:1786400605.322585:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 734: rc = 0 00100000:10000000:0.0:1786400605.322912:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 734: rc = 0 00100000:10000000:0.0:1786400605.325587:0:14847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 734: rc = 0 00000020:00000080:0.0:1786400605.326326:0:14847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1786400605.326342:0:14847:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1786400605.326355:0:14847:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x49554f35ff0a623c 00000020:01000004:0.0:1786400605.326366:0:14847:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1786400605.326393:0:14847:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.123@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1786400605.326398:0:14847:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1786400605.326405:0:14847:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1786400605.326410:0:14847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1786400605.326423:0:14847:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9373b9c04d40) 00000020:00000080:0.0:1786400605.326436:0:14847:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1786400605.354210:0:14847:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786400605.357853:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1786400605.357868:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1786400605.363112:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1786400605.363128:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1786400605.364440:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1786400605.364450:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1786400605.370891:0:14847:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400605.371073:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1786400605.371079:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1786400605.375493:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1786400605.375512:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1786400605.437291:0:14847:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400605.437502:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1786400605.437509:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1786400605.442801:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1786400605.442818:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1786400605.443733:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1786400605.443775:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1786400605.447557:0:14847:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400605.447777:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1786400605.447783:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1786400605.460978:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1786400605.460997:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1786400605.520415:0:14847:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400605.521976:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1786400605.521990:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1786400605.525918:0:14847:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1786400605.525935:0:14847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1786400605.528007:0:14847:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1786400605.528039:0:14847:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1786400605.528045:0:14847:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1786400605.548165:0:14847:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786400605.548206:0:14847:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.123@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1786400605.548211:0:14847:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786400605.548212:0:14847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786400605.548213:0:14847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400605.548215:0:14847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400605.548215:0:14847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400605.548217:0:14847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400605.548218:0:14847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400605.548220:0:14847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400605.548221:0:14847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786400605.548225:0:14847:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1786400605.548227:0:14847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786400605.548228:0:14847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786400605.548233:0:14847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400605.548234:0:14847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400605.548234:0:14847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400605.548235:0:14847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400605.548236:0:14847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400605.548237:0:14847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400605.548238:0:14847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786400605.548265:0:14847:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1786400605.548289:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392988928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1786400605.548376:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400605.548437:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba480 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.548530:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392988928 00000100:00100000:0.0:1786400605.548538:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392988928 00000100:00100000:0.0:1786400605.548599:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786400605.548608:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14847:x1873176392988928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786400605.548645:0:14203:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1786400605.548655:0:14203:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1786400605.548659:0:14203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1786400605.574105:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14847:x1873176392988928:12345-0@lo:253:mount.lustre.0 Request processed in 25487us (25718us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.574122:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786400605.574344:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392988928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1786400605.574358:0:14847:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1786400605.574362:0:14847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786400605.574364:0:14847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786400605.574365:0:14847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400605.574366:0:14847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400605.574367:0:14847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400605.574369:0:14847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400605.574371:0:14847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400605.574372:0:14847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400605.574374:0:14847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1786400605.574395:0:14847:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9373b8908800 from lustre-OST0000 10000000:01000000:3.0:1786400605.574429:0:14847:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1786400605.574432:0:14847:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1786400605.574439:0:14847:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9373b7b599c0 local copy 00010000:00010000:3.0:1786400605.574451:0:14847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400605.574917:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400605.574960:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400605.575045:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba480 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.575462:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392989056 00000100:00100000:0.0:1786400605.575469:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392989056 00000100:00100000:0.0:1786400605.575519:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786400605.575528:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14847:x1873176392989056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400605.576047:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14847:x1873176392989056:12345-0@lo:501:mount.lustre.0 Request processed in 518us (1085us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400605.576055:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786400605.580123:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989056:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1786400605.580170:0:14847:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1786400605.580444:0:14847:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1786400605.580455:0:14847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.580466:0:14847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400605.580498:0:14847:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9373b8908800 10000000:01000000:2.0:1786400605.580503:0:14847:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1786400605.580508:0:14847:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9373b7b599c0 10000000:01000000:2.0:1786400605.580511:0:14847:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1786400605.580514:0:14847:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9373b7b599c0 from 1 10000000:01000000:2.0:1786400605.580517:0:14847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1786400605.580555:0:14847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f600/0x49554f35ff0a624a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.580581:0:14847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f600/0x49554f35ff0a624a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.580857:0:14847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f600/0x49554f35ff0a624a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400605.580881:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786400605.580961:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400605.581001:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a99d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.581110:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392989184 00000100:00100000:0.0:1786400605.581117:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392989184 00000100:00100000:0.0:1786400605.581171:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786400605.581180:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+12:14847:x1873176392989184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400605.581195:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400605.581211:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f49800/0x49554f35ff0a6251 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a624a expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.581234:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f49800/0x49554f35ff0a6251 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a624a expref: 13 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.581245:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f49800/0x49554f35ff0a6251 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a624a expref: 13 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.581255:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49800, rc 0) 00000100:00100000:0.0:1786400605.581301:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+13:14847:x1873176392989184:12345-0@lo:101:mount.lustre.0 Request processed in 121us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.581316:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786400605.581449:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786400605.581462:0:14847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f600/0x49554f35ff0a624a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6251 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.581472:0:14847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f600/0x49554f35ff0a624a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6251 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400605.581491:0:14847:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1786400605.581508:0:14847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f600/0x49554f35ff0a624a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6251 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.581516:0:14847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b7a1f600/0x49554f35ff0a624a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6251 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400605.581523:0:14847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1786400605.581528:0:14847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786400605.581533:0:14847:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1786400605.581536:0:14847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786400605.581551:0:14847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1e000/0x49554f35ff0a6258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.581559:0:14847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b7a1e000/0x49554f35ff0a6258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.581833:0:14847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b7a1e000/0x49554f35ff0a6258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400605.581848:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786400605.581879:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400605.581900:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a99d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.581960:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392989312 00000100:00100000:0.0:1786400605.581965:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392989312 00000100:00100000:0.0:1786400605.582001:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786400605.582009:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+13:14847:x1873176392989312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400605.582017:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400605.582026:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f48e00/0x49554f35ff0a625f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a6258 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.582042:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f48e00/0x49554f35ff0a625f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a6258 expref: 14 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.582051:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f48e00/0x49554f35ff0a625f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6258 expref: 14 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.582058:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48e00, rc 0) 00000100:00100000:0.0:1786400605.582093:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989312:12345-0@lo:101:mount.lustre.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.582099:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786400605.582209:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786400605.582220:0:14847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b7a1e000/0x49554f35ff0a6258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a625f expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.582228:0:14847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b7a1e000/0x49554f35ff0a6258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a625f expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400605.585071:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1786400605.587340:0:14847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786400605.589153:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1786400605.589231:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1786400605.589263:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1786400605.589310:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1786400605.589343:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1786400605.589376:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1786400605.589451:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1786400605.589458:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1786400605.589555:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786400605.602892:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400605.602935:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a99d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.603227:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392989440 00000100:00100000:0.0:1786400605.603237:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392989440 00000100:00100000:0.0:1786400605.603290:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786400605.603299:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400605.603787:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989440:12345-0@lo:501:mount.lustre.0 Request processed in 488us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.603796:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786400605.604303:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786400605.604367:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786400605.604415:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400605.604442:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a99d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.604769:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392989568 00000100:00100000:0.0:1786400605.604780:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392989568 00000100:00100000:0.0:1786400605.604819:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786400605.604826:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786400605.605148:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989568:12345-0@lo:503:mount.lustre.0 Request processed in 322us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.605156:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786400605.605415:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1786400605.605979:0:14847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786400605.606044:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786400605.606092:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400605.606117:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b73726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400605.607960:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392989696 00000100:00100000:1.0:1786400605.607974:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392989696 00000100:00100000:1.0:1786400605.608043:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786400605.608051:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786400605.608351:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989696:12345-0@lo:502:mount.lustre.0 Request processed in 299us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400605.608358:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786400605.608950:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1786400605.609238:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1786400605.609296:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1786400605.609328:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1786400605.609377:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1786400605.609426:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1786400605.609458:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1786400605.609516:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1786400605.609552:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1786400605.613056:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1786400605.613153:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1786400605.613188:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1786400605.613232:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1786400605.613284:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786400605.613370:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400605.613419:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b73726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400605.615844:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392989824 00000100:00100000:1.0:1786400605.615874:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392989824 00000100:00100000:1.0:1786400605.615931:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786400605.615952:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786400605.616221:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989824:12345-0@lo:502:mount.lustre.0 Request processed in 269us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400605.616229:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1786400605.616340:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786400605.616451:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1786400605.616465:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1786400605.619468:0:14861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786400605.619479:0:14861:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1786400605.619486:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400605.619488:0:14861:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1786400605.619494:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786400605.619510:0:14861:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9373a0c53380) 00000020:00000080:1.0:1786400605.619532:0:14861:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786400605.619538:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786400605.619630:0:14861:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9373b8908800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1786400605.619639:0:14861:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786400605.619647:0:14861:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x49554f35ff0a626d 00010000:00010000:1.0:1786400605.631226:0:14861:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1786400605.634238:0:14861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1786400605.652300:0:14861:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1786400605.653692:0:14861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1786400605.653706:0:14861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400605.653713:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400605.653716:0:14861:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1786400605.653719:0:14861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786400605.653722:0:14861:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1786400605.653724:0:14861:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786400605.653725:0:14861:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786400605.653726:0:14861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786400605.653729:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400605.653730:0:14861:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786400605.653770:0:14861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400605.653773:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400605.653775:0:14861:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786400605.653778:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786400605.653779:0:14861:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786400605.653781:0:14861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400605.653784:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400605.653785:0:14861:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1786400605.653787:0:14861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400605.653788:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400605.653790:0:14861:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786400605.653792:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1786400605.653850:0:14861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400605.653853:0:14861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400605.653854:0:14861:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786400605.653857:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1786400605.654072:0:14847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1786400605.654104:0:14847:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1786400605.654127:0:14847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1e000/0x49554f35ff0a6258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a625f expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.654139:0:14847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b7a1e000/0x49554f35ff0a6258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a625f expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400605.654147:0:14847:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373b8908800 from 1 10000000:01000000:0.0:1786400605.654151:0:14847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400605.654184:0:14847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.654193:0:14847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.654204:0:14847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400605.654227:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786400605.654296:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.654338:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392989952 00000100:00100000:0.0:1786400605.654346:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392989952 00000100:00100000:0.0:1786400605.654397:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786400605.654407:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+14:14847:x1873176392989952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400605.654422:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400605.654434:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a6274 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.654458:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 15 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.654469:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 15 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.654478:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48400, rc 0) 00000100:00100000:0.0:1786400605.654511:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392989952:12345-0@lo:101:mount.lustre.0 Request processed in 105us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.654517:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786400605.654563:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e600 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.654595:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392989952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400605.654608:0:14847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.654617:0:14847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786400605.655149:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1786400605.655862:0:14847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786400605.656110:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1786400605.656149:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1786400605.656207:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1786400605.656225:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1786400605.656288:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400605.656339:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.656367:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e600 going to sleep for 11 seconds 00000100:00100000:2.0:1786400605.658810:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392990080 00000100:00100000:2.0:1786400605.658824:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392990080 00000100:00100000:2.0:1786400605.658879:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786400605.658898:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786400605.659205:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990080:12345-0@lo:501:mount.lustre.0 Request processed in 308us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400605.659214:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786400605.659724:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400605.661917:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990208:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786400605.661997:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.662089:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400605.673453:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392990208 00000100:00100000:3.0:1786400605.673467:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392990208 00000100:00100000:3.0:1786400605.673528:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786400605.673541:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786400605.673821:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990208:12345-0@lo:503:mount.lustre.0 Request processed in 283us (11823us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400605.673829:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786400605.675024:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990208:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1786400605.675829:0:14847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786400605.675913:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786400605.675983:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.676032:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400605.676637:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392990336 00000100:00100000:1.0:1786400605.676644:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392990336 00000100:00100000:1.0:1786400605.676700:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786400605.676710:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786400605.676947:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990336:12345-0@lo:502:mount.lustre.0 Request processed in 237us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400605.676963:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786400605.676978:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786400605.677222:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1786400605.677270:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1786400605.677332:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1786400605.677372:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1786400605.677403:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1786400605.677474:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1786400605.677512:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1786400605.677539:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1786400605.677581:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786400605.677678:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.677716:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400605.678054:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392990464 00000100:00100000:2.0:1786400605.678060:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392990464 00000100:00100000:2.0:1786400605.678096:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786400605.678104:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786400605.678281:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990464:12345-0@lo:502:mount.lustre.0 Request processed in 178us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400605.678289:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786400605.678580:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786400605.678775:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1786400605.678793:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1786400605.681372:0:14865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400605.681385:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400605.681387:0:14865:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786400605.681394:0:14865:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373b8908800 00000020:00000080:2.0:1786400605.681396:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786400605.681402:0:14865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400605.681404:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400605.681405:0:14865:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1786400605.681408:0:14865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400605.681410:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400605.681411:0:14865:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786400605.681413:0:14865:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373b8908800 00000020:00000080:2.0:1786400605.681415:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786400605.681509:0:14865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400605.681513:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400605.681514:0:14865:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1786400605.681516:0:14865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400605.681519:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400605.681520:0:14865:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786400605.681530:0:14865:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9373b8908800 00000020:00000080:2.0:1786400605.681532:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786400605.682068:0:14865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400605.682074:0:14865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400605.682075:0:14865:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1786400605.682079:0:14865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1786400605.689091:0:14847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1786400605.689133:0:14847:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786400605.689162:0:14847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.689176:0:14847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400605.689232:0:14847:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1786400605.689235:0:14847:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9373b8908800 10000000:01000000:0.0:1786400605.689238:0:14847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9373b8908800 10000000:01000000:0.0:1786400605.689241:0:14847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786400605.689247:0:14847:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373b8908800 from 1 10000000:01000000:0.0:1786400605.689250:0:14847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786400605.689285:0:14847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f48000/0x49554f35ff0a6282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.689293:0:14847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b8f48000/0x49554f35ff0a6282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.689304:0:14847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b8f48000/0x49554f35ff0a6282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400605.689331:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786400605.689405:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.689449:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.689844:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392990592 00000100:00100000:0.0:1786400605.689852:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392990592 00000100:00100000:0.0:1786400605.689914:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786400605.689924:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392990592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400605.689952:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400605.689966:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f48200/0x49554f35ff0a6289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a6282 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.689988:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f48200/0x49554f35ff0a6289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a6282 expref: 16 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.689998:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f48200/0x49554f35ff0a6289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6282 expref: 16 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.690006:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48200, rc 0) 00000100:00100000:0.0:1786400605.690048:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392990592:12345-0@lo:101:mount.lustre.0 Request processed in 127us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.690055:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786400605.690101:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400605.690115:0:14847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b8f48000/0x49554f35ff0a6282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6289 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.690123:0:14847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b8f48000/0x49554f35ff0a6282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6289 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786400605.693890:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1786400605.694215:0:14847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786400605.694430:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1786400605.694473:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1786400605.694506:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1786400605.694551:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1786400605.694602:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1786400605.695865:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1786400605.695933:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1786400605.695967:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1786400605.696015:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1786400605.696064:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1786400605.696097:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1786400605.696140:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1786400605.696175:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1786400605.696207:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1786400605.696266:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1786400605.696302:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1786400605.696335:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1786400605.696380:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1786400605.696413:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1786400605.696444:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1786400605.696483:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1786400605.696513:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1786400605.696544:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1786400605.696619:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1786400605.700940:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1786400605.700998:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1786400605.701070:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1786400605.701108:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1786400605.701196:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1786400605.701203:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1786400605.701331:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400605.701399:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.701448:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400605.701884:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392990720 00000100:00100000:2.0:1786400605.701893:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392990720 00000100:00100000:2.0:1786400605.701943:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786400605.701951:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392990720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786400605.702191:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392990720:12345-0@lo:501:mount.lustre.0 Request processed in 240us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400605.702200:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786400605.704846:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400605.704916:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786400605.704994:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.705049:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400605.705725:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392990848 00000100:00100000:3.0:1786400605.705733:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392990848 00000100:00100000:3.0:1786400605.705813:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786400605.705822:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392990848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786400605.706021:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392990848:12345-0@lo:503:mount.lustre.0 Request processed in 199us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400605.706030:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786400605.718822:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1786400605.719407:0:14847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786400605.719505:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786400605.721835:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.722796:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400605.729859:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392990976 00000100:00100000:3.0:1786400605.729876:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392990976 00000100:00100000:3.0:1786400605.729933:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786400605.729943:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392990976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786400605.730229:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392990976:12345-0@lo:502:mount.lustre.0 Request processed in 287us (8401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400605.730237:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786400605.730483:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392990976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786400605.731322:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1786400605.731391:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1786400605.731425:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1786400605.731471:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1786400605.731506:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1786400605.731552:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1786400605.731833:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1786400605.731869:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1786400605.731916:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1786400605.731972:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1786400605.732008:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1786400605.732057:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1786400605.732093:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1786400605.732125:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1786400605.732188:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1786400605.732228:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1786400605.732260:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1786400605.732309:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1786400605.732345:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1786400605.732378:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1786400605.732427:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1786400605.732468:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1786400605.732501:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1786400605.732559:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1786400605.739053:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1786400605.739121:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1786400605.739205:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1786400605.739240:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1786400605.739273:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1786400605.739321:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1786400605.739361:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1786400605.739413:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1786400605.739448:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1786400605.739492:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1786400605.739526:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1786400605.739583:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1786400605.739622:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1786400605.739655:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1786400605.739703:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1786400605.739770:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1786400605.739828:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392991104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786400605.739907:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.739948:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b048e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400605.740858:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392991104 00000100:00100000:3.0:1786400605.740868:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392991104 00000100:00100000:3.0:1786400605.740917:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786400605.740925:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392991104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786400605.741173:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392991104:12345-0@lo:502:mount.lustre.0 Request processed in 248us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400605.741183:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786400605.742414:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392991104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786400605.742536:0:14847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1786400605.742549:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1786400605.745094:0:14870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1786400605.745111:0:14870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9373b9c019c0) 00000020:00000080:0.0:1786400605.745133:0:14870:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1786400605.745319:0:14870:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9373b8908800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1786400605.745324:0:14870:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9373b8908800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1786400605.745326:0:14870:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373b8908800 3 00010000:00080000:0.0:1786400605.745354:0:14870:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373b9c5b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.123@tcp at head 00010000:00010000:0.0:1786400605.750924:0:14870:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1786400605.751055:0:14870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1786400605.751097:0:14870:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786400605.751110:0:14870:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x49554f35ff0a6297 00000100:00080000:0.0:1786400605.751121:0:14870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786400605.751127:0:14870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9373b9c5b000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:0.0:1786400605.751166:0:14870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937282720e00 x1873176392991232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786400605.751258:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1873176392991232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786400605.751329:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786400605.751693:0:14870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1786400605.751717:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786400605.751721:0:10440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1786400605.751724:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786400605.751727:0:10440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1786400605.751786:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400605.751796:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392991360:0@lo:400:kworker.0 00000100:00100000:0.0:1786400605.751828:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400605.754784:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392991232 00000100:00100000:3.0:1786400605.754796:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392991232 00000100:00100000:3.0:1786400605.754838:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392991360 00000100:00100000:3.0:1786400605.754841:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392991360 00000100:00100000:3.0:1786400605.754870:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400605.754879:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392991360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400605.754983:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1873176392991360:12345-0@lo:400:kworker.0 Request processed in 104us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400605.754991:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400605.755009:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400605.755013:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1873176392991232:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1786400605.755039:0:14212:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1786400605.755083:0:14212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x49554f35ff0a629e 00000004:00100000:3.0:1786400605.755099:0:14212:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786400605.755131:0:14212:0:(import.c:65:import_set_state_nolock()) ffff9373b6eb8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786400605.756287:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873176392991232:12345-0@lo:38:llog_process_th.0 Request processed in 1266us (4952us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400605.756296:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1786400605.756355:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff937282720a80 x1873176392991360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400605.756370:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1873176392991360:0@lo:400:kworker.0 00010000:00080000:2.0:1786400605.762266:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff937282720e00 x1873176392991232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400605.762282:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786400605.762295:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1786400605.762307:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1786400605.762314:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1786400605.762317:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b9c5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786400605.762324:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1873176392991232:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1786400605.762821:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1786400605.763169:0:14847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1786400605.763197:0:14847:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786400605.763249:0:14847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f48000/0x49554f35ff0a6282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6289 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400605.763274:0:14847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b8f48000/0x49554f35ff0a6282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6289 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1786400605.763315:0:14847:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1786400605.763317:0:14847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786400605.763319:0:14847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400605.763320:0:14847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400605.763321:0:14847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400605.763322:0:14847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400605.763323:0:14847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786400605.763325:0:14847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400605.763326:0:14847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786400605.763331:0:14847:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1786400605.763333:0:14847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786400605.763334:0:14847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786400605.763335:0:14847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400605.763337:0:14847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400605.763338:0:14847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400605.763339:0:14847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400605.763340:0:14847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786400605.763342:0:14847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400605.763343:0:14847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786400605.763365:0:14847:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1786400605.763914:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392991488:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786400605.763990:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400605.764037:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373863d8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.764099:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392991488 00000100:00100000:0.0:1786400605.764106:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392991488 00000100:00100000:0.0:1786400605.764158:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786400605.764168:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14847:x1873176392991488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786400605.764213:0:14203:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786400605.764228:0:14203:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1786400605.780236:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1786400605.828786:0:14203:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786400605.828801:0:14203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1786400605.828861:0:14227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786400605.828867:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786400605.828890:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400605.828909:0:14227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a620b expref: 16 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400605.828925:0:14227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400605.828965:0:14227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a620b expref: 16 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400605.828978:0:14227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a620b expref: 16 pid: 14206 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400605.828993:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14227:1873176392991616:0@lo:104: 00000100:00100000:1.0:1786400605.829061:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400605.829112:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738d7bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400605.829481:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392991616 00000100:00100000:0.0:1786400605.829490:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392991616 00000100:00100000:0.0:1786400605.829540:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400605.829557:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7723100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:14227:x1873176392991616:12345-0@lo:104: 00010000:00010000:0.0:1786400605.829581:0:14194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.829645:0:14194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786400605.829652:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7723100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:14227:x1873176392991616:12345-0@lo:104: Request processed in 96us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.829659:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1786400605.829690:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400605.829697:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.829706:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:0.0:1786400605.829710:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.829720:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400605.829728:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400605.829733:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786400605.829791:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.829797:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400605.829815:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.829832:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399762a00/0x49554f35ff0a620b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a6212 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.829850:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400605.829852:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400605.829854:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400605.829867:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3316:1873176392991744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400605.829896:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400605.829948:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392991744 00000100:00100000:0.0:1786400605.829952:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392991744 00010000:00010000:0.0:1786400605.829967:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a620b expref: 17 pid: 14206 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400605.829988:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400605.829993:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:3316:x1873176392991744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400605.830003:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400605.830007:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a620b expref: 17 pid: 14206 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830016:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a620b expref: 17 pid: 14206 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830031:0:14198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830038:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786400605.830050:0:14198:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001184095s 00010000:00010000:0.0:1786400605.830060:0:14198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830066:0:14198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830072:0:14198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830077:0:14198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830081:0:14198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400605.830086:0:14198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830093:0:14198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830100:0:14198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400605.830110:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400605.830137:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:3316:x1873176392991744:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400605.830143:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400605.830177:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3316:1873176392991744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400605.830384:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a620b expref: 16 pid: 14206 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400605.830396:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14227:1873176392991616:0@lo:104: 00010000:00010000:1.0:1786400605.830411:0:14227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400605.830420:0:14227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400605.830426:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400605.830431:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebe400/0x49554f35ff0a62a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400605.843162:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14847:x1873176392991488:12345-0@lo:253:mount.lustre.0 Request processed in 78984us (79160us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400605.843194:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786400605.843310:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14847:1873176392991488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786400605.843327:0:14847:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1786400605.843330:0:14847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786400605.843338:0:14847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786400605.843339:0:14847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400605.843341:0:14847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400605.843342:0:14847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400605.843343:0:14847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400605.843345:0:14847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400605.843346:0:14847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400605.843347:0:14847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1786400605.843363:0:14847:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1786400605.847295:0:14847:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400605.847444:0:14847:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1786400605.847610:0:14847:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400605.847853:0:14847:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786400605.847988:0:14847:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400605.848214:0:14847:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786400605.849417:0:14847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1786400605.912371:0:14847:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1786400605.912381:0:14847:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1786400605.912412:0:14847:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786400605.912515:0:14847:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786400605.912535:0:14847:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1786400605.912573:0:14847:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1786400606.811087:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786400607.253698:0:14208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786400607.253706:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff937399fd8000 from 7 10000000:01000000:3.0:1786400607.253712:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786400607.254449:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400607.254463:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400607.254473:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400607.254500:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392991872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786400607.254585:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400607.254643:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b043f000 going to sleep for 11 seconds 00000100:00100000:0.0:1786400607.254922:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392991872 00000100:00100000:0.0:1786400607.254930:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392991872 00000100:00100000:0.0:1786400607.255035:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786400607.255057:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+15:14208:x1873176392991872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400607.255071:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400607.255086:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a62ac expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400607.255109:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 16 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400607.255120:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 16 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400607.255130:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48800, rc 0) 00000100:00100000:0.0:1786400607.255182:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14208:x1873176392991872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400607.255201:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786400607.255278:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392991872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400607.255294:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400607.255302:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400607.255354:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392992000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786400607.255385:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400607.257305:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b043f000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400607.260807:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392992000 00000100:00100000:2.0:1786400607.260830:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392992000 00000100:00100000:2.0:1786400607.260890:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786400607.260900:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14208:x1873176392992000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786400607.260927:0:14206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786400607.260943:0:14206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786400607.260946:0:14206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1786400607.261104:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14208:x1873176392992000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (5715us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400607.261111:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786400607.261173:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392992000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1786400607.261239:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786400607.261249:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400607.261259:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400607.833478:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400608.852775:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400609.876900:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400610.901196:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786400611.224062:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786400611.224075:0:10440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786400611.224077:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786400611.224081:0:10440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786400611.226596:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3317:1873176392992128:0@lo:400:kworker.0 00000100:00100000:2.0:1786400611.226681:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400611.226805:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400611.226813:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392992256:0@lo:400:kworker.0 00000100:00100000:2.0:1786400611.226854:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400611.227085:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392992384:0@lo:400:kworker.0 00000100:00100000:0.0:1786400611.227116:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400611.227156:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392992256 00000100:00100000:0.0:1786400611.227164:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392992256 00000100:00100000:0.0:1786400611.227205:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392992384 00000100:00100000:0.0:1786400611.227208:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392992384 00000100:00100000:0.0:1786400611.227231:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400611.227238:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392992256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400611.227291:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392992256:12345-0@lo:400:kworker.0 Request processed in 53us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400611.227299:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400611.227313:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400611.227319:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392992384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400611.227344:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392992384:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400611.227350:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1786400611.227381:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b7720700 x1873176392992384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400611.227394:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392992384:0@lo:400:kworker.0 00010000:00080000:0.0:1786400611.227713:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b7722a00 x1873176392992256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400611.227735:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392992256:0@lo:400:kworker.0 00000100:00080000:2.0:1786400611.227989:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400611.229393:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392992128 00000100:00100000:3.0:1786400611.229403:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392992128 00000100:00100000:3.0:1786400611.229464:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786400611.229483:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:3317:x1873176392992128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400611.229638:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:3317:x1873176392992128:12345-0@lo:400:kworker.0 Request processed in 166us (2956us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400611.229645:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786400611.229792:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3317:1873176392992128:0@lo:400:kworker.0 00010000:00010000:0.0:1786400611.923082:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400612.947018:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400612.965259:0:15213:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1786400613.395364:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786400613.971011:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400615.001210:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400616.019042:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400601/real 1786400601] req@ffff9373b0517100 x1873176392988160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786400616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400616.019078:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9373b0517100 x1873176392988160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786400616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400616.019089:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400601/real 1786400601] req@ffff9373b0514700 x1873176392988288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786400616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400616.019112:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9373b0514700 x1873176392988288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786400616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786400616.019131:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b7355800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786400616.019147:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1786400616.019151:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392988160:0@lo:8:kworker.0 00000100:00080000:0.0:1786400616.019156:0:3314:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786400616.019161:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1786400616.019164:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392988288:0@lo:8:kworker.0 00000100:00080000:3.0:1786400616.019428:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786400616.019433:0:10440:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1786400616.019436:0:10440:0:(import.c:65:import_set_state_nolock()) ffff9373b7355800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786400616.019441:0:10440:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:3.0:1786400616.019445:0:10440:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786400616.019451:0:10440:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9373b7355800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1786400616.019471:0:10440:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93728239f100 x1873176392992640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786400616.019484:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786400616.019487:0:10440:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1786400616.019489:0:10440:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786400616.019492:0:10440:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:3.0:1786400616.019494:0:10440:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786400616.019497:0:10440:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937386eec800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1786400616.019497:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400616.019507:0:10440:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93728239c000 x1873176392992768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786400616.019511:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176392992512:0@lo:400:kworker.0 00000100:00100000:3.0:1786400616.019555:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392992640:0@lo:8:kworker.0 00000100:00100000:2.0:1786400616.019572:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400616.019585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400616.019653:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392992640 00000100:00100000:0.0:1786400616.019661:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392992640 00000100:00100000:3.0:1786400616.019706:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392992768:0@lo:8:kworker.0 00000100:00100000:3.0:1786400616.019765:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400616.022790:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392992512 00000100:00100000:2.0:1786400616.022806:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392992512 00000100:00100000:2.0:1786400616.022872:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786400616.022883:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:3315:x1873176392992512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400616.022972:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:3315:x1873176392992512:12345-0@lo:400:kworker.0 Request processed in 90us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400616.022979:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1786400616.023050:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400616.023099:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176392992512:0@lo:400:kworker.0 00000100:00100000:2.0:1786400616.023147:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392992896:0@lo:400:kworker.0 00000100:00100000:2.0:1786400616.023181:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400616.023207:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400616.023213:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392993024:0@lo:400:kworker.0 00000100:00100000:2.0:1786400616.023233:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400616.023255:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392992896 00000100:00100000:2.0:1786400616.023258:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392992896 00000100:00100000:2.0:1786400616.023284:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392993024 00000100:00100000:2.0:1786400616.023286:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392993024 00000100:00100000:2.0:1786400616.023311:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786400616.023317:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392992896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400616.023351:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392992896:12345-0@lo:400:kworker.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400616.023357:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786400616.024524:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400616.024541:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392993024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400616.024605:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392993024:12345-0@lo:400:kworker.0 Request processed in 72us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400616.024795:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1786400616.024832:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786400616.024867:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93728239d180 x1873176392993024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400616.024882:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392993024:0@lo:400:kworker.0 00010000:00080000:2.0:1786400616.024893:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93728239ea00 x1873176392992896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400616.024902:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392992896:0@lo:400:kworker.0 00000100:00100000:0.0:1786400616.038362:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392992768 00000100:00100000:0.0:1786400616.038380:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392992768 00000100:00100000:0.0:1786400616.038435:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400616.038444:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1873176392992640:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1786400616.038489:0:14849:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:0.0:1786400616.038522:0:14849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a62ba 00002000:00100000:0.0:1786400616.038541:0:14849:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9373b9c58800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1786400616.038546:0:14849:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1786400616.038549:0:14849:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1786400616.038895:0:14849:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786400616.038921:0:14849:0:(import.c:65:import_set_state_nolock()) ffff9373b9c5a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400616.039004:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1873176392992640:12345-0@lo:8:kworker.0 Request processed in 559us (19416us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400616.039011:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786400616.041925:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93728239f100 x1873176392992640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786400636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400616.041941:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786400616.041951:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1786400616.041961:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1786400616.041969:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1786400616.041973:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373b7355800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1786400616.042004:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1786400616.042010:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392992640:0@lo:8:kworker.0 00000004:00080000:3.0:1786400616.042039:0:14233:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1786400616.042212:0:14234:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1786400616.042233:0:14234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0516a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14234:1873176392993280:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1786400616.042291:0:14234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400616.042313:0:14234:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fd0540 going to sleep for 11 seconds 00000100:00100000:2.0:1786400616.042328:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400616.042337:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392993152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400616.042362:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400616.042422:0:14852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392993152 00000100:00100000:2.0:1786400616.042428:0:14852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392993152 00000100:00100000:2.0:1786400616.042551:0:14852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400616.042561:0:14852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1873176392993152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400616.042641:0:14852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400616.042727:0:14852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1873176392993152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400616.042735:0:14852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786400616.042801:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9373b0516680 x1873176392993152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400616.042828:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392993152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786400616.042850:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400616.042873:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392993280 00000100:00100000:2.0:1786400616.042876:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392993280 00000100:00100000:2.0:1786400616.042892:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400616.042898:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1873176392992768:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1786400616.042914:0:14851:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786400616.042943:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1873176392992768:12345-0@lo:8:kworker.0 Request processed in 44us (23204us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786400616.042948:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400616.042960:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400616.042965:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14234:x1873176392993280:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1786400616.043412:0:14233:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 537784671606ns, next at 0ns, rc = 0 00002000:00080000:2.0:1786400616.049298:0:14851:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1786400616.049310:0:14851:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1786400616.049315:0:14851:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:3.0:1786400616.053401:0:3314:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786400616.053415:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786400616.053421:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392992768:0@lo:8:kworker.0 00002000:00010000:2.0:1786400616.075801:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.075814:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.075829:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.075833:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.075839:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.075855:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.075870:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.075876:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.075896:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786400616.076317:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.076323:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.076331:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.076335:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.076339:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.076348:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.076356:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.076363:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083504:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786400616.083536:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786400616.083545:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083557:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fe00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.083562:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083572:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083593:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083600:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5fd7a01/0x49554f35ff0a62c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083636:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.083641:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083646:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ea00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.083650:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083680:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083689:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083697:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f17d8154/0x49554f35ff0a62c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.083708:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.083710:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.083711:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.084278:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.084286:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084297:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.084301:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.084307:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084317:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084325:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084337:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084354:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.084361:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.084364:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084370:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ee00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.084373:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084381:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084405:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084411:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027b17f64/0x49554f35ff0a62cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084423:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.084425:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.084426:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.084792:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.084804:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084812:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.084815:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.084819:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084828:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084835:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084842:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084854:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.084861:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.084864:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084871:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.084874:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084881:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084896:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084904:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000508ab1b2/0x49554f35ff0a62d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.084915:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.084917:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.084918:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.085257:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.085263:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085271:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.085274:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.085278:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085287:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085294:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085300:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085323:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.085331:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.085334:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085341:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fc00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.085344:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085352:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085363:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085370:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af8a1eed/0x49554f35ff0a62dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085381:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.085383:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.085399:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.085872:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.085879:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085888:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.085895:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.085900:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085909:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085917:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085925:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085936:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.085944:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.085948:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085954:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.085958:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085965:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085976:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.085992:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a62e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.086005:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.086007:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.086009:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.086372:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.086378:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090821:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.090827:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.090836:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090857:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090870:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090879:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090911:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.090932:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.090951:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090958:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.090963:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090972:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090988:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.090995:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd9c491d/0x49554f35ff0a62eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.091021:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.091023:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.091024:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.094311:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.094324:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.094341:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.094344:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.094350:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.094375:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.094396:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.094404:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.094429:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.094457:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.094464:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.094471:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.094476:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.095211:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.095234:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.095241:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000919765a4/0x49554f35ff0a62f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.095270:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.095272:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.095274:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400616.095339:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.098241:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.098255:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.098270:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.098274:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.098280:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.098294:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.098304:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.098312:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.098333:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.098346:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.098352:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.099170:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ec00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.099175:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.099185:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.099201:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.099208:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fedd7b27/0x49554f35ff0a62f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.099229:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.099231:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.099232:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.100929:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.100940:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.100954:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.100957:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.100963:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.100975:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.100989:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.100997:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.101021:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786400616.104876:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400616.104892:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400616.104906:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:3.0:1786400616.104911:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400616.104922:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400616.104966:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400616.104975:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015e2b575/0x49554f35ff0a6300 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400616.105003:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400616.105005:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400616.105006:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.109192:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.109208:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109225:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.109229:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.109234:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109247:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109256:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109263:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109303:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.109320:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.109325:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109332:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e600 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.109337:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109346:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109363:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109370:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb9115d/0x49554f35ff0a6307 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.109404:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.109406:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.109408:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.111660:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.111672:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111688:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.111696:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.111702:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111715:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111724:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111731:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111766:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.111781:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.111787:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111795:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fa00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.111800:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111808:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111822:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111839:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a122d2e6/0x49554f35ff0a630e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.111858:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.111860:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.111861:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.131085:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.131160:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131177:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.131181:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.131186:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131201:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131211:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131217:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131244:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.131257:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.131273:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131279:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f000 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.131284:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131294:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131308:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131314:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099c6e44b/0x49554f35ff0a6315 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.131337:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.131339:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.131341:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.134063:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.134076:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.135942:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.135952:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.135961:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.135996:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.136006:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.136013:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.136112:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.136125:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.136131:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.136139:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4e00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.136144:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.136153:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.136169:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.136177:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f69d797/0x49554f35ff0a631c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.136203:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.136205:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.136207:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.138062:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.138075:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.141967:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.141984:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.141995:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142017:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142029:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142037:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142071:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.142087:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.142299:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142327:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.142331:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142340:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142357:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142365:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030a4b8be/0x49554f35ff0a6323 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.142403:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.142406:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.142408:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.144114:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.144125:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144140:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.144144:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.144150:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144162:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144178:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144186:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144206:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.144221:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.144226:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144233:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5600 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.144238:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144246:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144259:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144266:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000931229a9/0x49554f35ff0a632a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.144283:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.144289:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.144291:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.145049:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.145057:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145065:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.145068:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.145072:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145082:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145148:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145157:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145173:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.145183:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.145187:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145195:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5000 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.145198:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145221:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145233:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145240:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000920c5f76/0x49554f35ff0a6331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.145254:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.145256:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.145257:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.146372:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.146380:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146402:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.146405:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.146410:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146420:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146428:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146441:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146456:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.146465:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.146469:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146476:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5e00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.146479:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146602:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146627:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146634:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d328548/0x49554f35ff0a6338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.146650:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.146652:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.146654:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.150239:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.150261:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150279:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.150283:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.150290:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150305:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150316:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150323:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150342:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.150354:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.150359:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150367:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4200 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.150372:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150382:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150884:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150892:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac905cca/0x49554f35ff0a633f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.150910:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.150912:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.150914:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.152302:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.152313:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152328:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.152332:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.152337:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152350:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152360:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152368:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152414:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.152429:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.152434:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152442:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.152446:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152455:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152470:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.152478:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000211f7853/0x49554f35ff0a6346 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.156683:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.156685:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.156688:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.157839:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.157850:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157866:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.157875:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.157881:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157894:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157903:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157910:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157930:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.157942:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.157946:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157952:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5c00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.157957:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157966:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157980:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.157995:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000970b67e6/0x49554f35ff0a634d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.158011:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.158013:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.158014:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.158950:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.158959:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.158969:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.158973:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.158978:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.158988:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.158997:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.159004:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.159019:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400616.159028:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400616.159040:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.159047:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f5a00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400616.159051:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.159059:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.159070:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.159077:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6685c81/0x49554f35ff0a6354 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.159156:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.159158:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400616.159159:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.159958:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.159966:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.159977:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.159980:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.159985:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.160005:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.160013:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.160020:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.160039:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786400616.161815:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400616.161825:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400616.161837:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4a00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400616.161842:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400616.161851:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400616.161872:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400616.161880:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c97d7ff/0x49554f35ff0a635b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400616.161913:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400616.161915:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400616.161916:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.162056:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.162065:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.162075:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.162079:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.162085:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.162366:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.162377:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.162407:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.162433:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786400616.163290:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.163298:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.163308:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.163311:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.163315:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.163323:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.163330:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.163337:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.163361:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786400616.163584:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400616.163591:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163600:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373994f4c00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400616.163604:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163613:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163630:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163637:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1aa547a/0x49554f35ff0a6362 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163658:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400616.163667:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163673:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102ec00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400616.163676:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163683:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163692:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163698:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ba5767d/0x49554f35ff0a6369 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.163708:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400616.163709:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400616.163711:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.164372:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.164379:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.164553:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.164556:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.164562:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.164573:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.164582:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.164588:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.164611:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786400616.165356:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400616.165363:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.165372:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102fa00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400616.165376:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.165407:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.165423:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.165431:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a6370 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.165459:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400616.165461:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400616.165463:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400616.165815:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400616.165887:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400616.165895:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.165905:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1786400616.165907:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400616.165913:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.165923:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.165941:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.165948:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400616.165969:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786400616.166040:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400616.166045:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.166052:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102ea00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400616.166055:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.166062:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.166073:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.166089:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032967510/0x49554f35ff0a6377 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400616.166102:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400616.166103:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400616.166105:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1786400616.166321:0:14851:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1786400616.166430:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14234:x1873176392993280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 123460us (124134us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400616.166439:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786400616.166603:0:14234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0516a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14234:1873176392993280:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1786400616.166617:0:14234:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1786400616.166662:0:14234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14234:1873176392993408:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1786400616.166698:0:14234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400616.166774:0:14234:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b049c180 going to sleep for 11 seconds 00000100:00100000:2.0:1786400616.166876:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392993408 00000100:00100000:2.0:1786400616.166884:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392993408 00000100:00100000:2.0:1786400616.166927:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786400616.166935:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14234:x1873176392993408:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1786400616.166974:0:14850:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:1.0:1786400616.167423:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1786400616.178420:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14234:x1873176392993408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11477us (11713us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1786400616.178433:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400616.178862:0:14234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14234:1873176392993408:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1786400616.178878:0:14234:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:1.0:1786400616.461314:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1786400616.461683:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1786400617.042940:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400618.076244:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400619.092146:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786400619.706734:0:15518:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786400619.706772:0:15518:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1786400619.706896:0:15518:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9373beb8b800 00000020:01000004:2.0:1786400619.706914:0:15518:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1786400619.706928:0:15518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1786400619.706943:0:15518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9373b91e99c0) 00000020:00000080:2.0:1786400619.706960:0:15518:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786400619.740290:0:15518:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786400619.741090:0:15518:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786400619.742086:0:15518:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786400619.742317:0:15518:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1786400619.742947:0:15518:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786400619.743303:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 333: rc = 0 00100000:10000000:3.0:1786400619.743483:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 333: rc = 0 00100000:10000000:3.0:1786400619.743724:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 333: rc = 0 00100000:10000000:3.0:1786400619.744299:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 344: rc = 0 00100000:10000000:3.0:1786400619.744696:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 344: rc = 0 00100000:10000000:3.0:1786400619.744985:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 344: rc = 0 00100000:10000000:3.0:1786400619.745239:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 344: rc = 0 00100000:10000000:3.0:1786400619.745646:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 344: rc = 0 00100000:10000000:2.0:1786400619.748211:0:15518:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 344: rc = 0 00000020:00000080:2.0:1786400619.749047:0:15518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1786400619.749060:0:15518:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786400619.749071:0:15518:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x49554f35ff0a6385 00000020:01000004:2.0:1786400619.749080:0:15518:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1786400619.749102:0:15518:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1786400619.749105:0:15518:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1786400619.749111:0:15518:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1786400619.749132:0:15518:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1786400619.749137:0:15518:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1786400619.764101:0:15518:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786400619.764142:0:15518:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.123@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1786400619.764147:0:15518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786400619.764148:0:15518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786400619.764150:0:15518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400619.764151:0:15518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400619.764152:0:15518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400619.764154:0:15518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400619.764155:0:15518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786400619.764156:0:15518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400619.764158:0:15518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786400619.764161:0:15518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1786400619.764164:0:15518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786400619.764165:0:15518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786400619.764166:0:15518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400619.764167:0:15518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400619.764168:0:15518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400619.764169:0:15518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400619.764170:0:15518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786400619.764171:0:15518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400619.764172:0:15518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786400619.764197:0:15518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1786400619.764217:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b0516680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392993536:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786400619.764296:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400619.764762:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738d7bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400619.764861:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392993536 00000100:00100000:0.0:1786400619.764869:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392993536 00000100:00100000:0.0:1786400619.764953:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786400619.764963:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:15518:x1873176392993536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786400619.764993:0:14203:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1786400619.764996:0:14203:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1786400619.764999:0:14203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1786400619.793187:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:15518:x1873176392993536:12345-0@lo:253:mount.lustre.0 Request processed in 28214us (28879us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400619.793215:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786400619.793859:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b0516680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392993536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786400619.793875:0:15518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786400619.793878:0:15518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786400619.793880:0:15518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786400619.793881:0:15518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400619.793882:0:15518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400619.793883:0:15518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400619.793885:0:15518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400619.793886:0:15518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400619.793888:0:15518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400619.793890:0:15518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786400619.793912:0:15518:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9373beb8b800 from lustre-OST0001 10000000:01000000:0.0:1786400619.793939:0:15518:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1786400619.793942:0:15518:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1786400619.793951:0:15518:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9373b7b599c0 local copy 00010000:00010000:0.0:1786400619.793962:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400619.794203:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392993664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400619.794246:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400619.794284:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400619.794547:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392993664 00000100:00100000:2.0:1786400619.794554:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392993664 00000100:00100000:2.0:1786400619.794599:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786400619.794608:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:15518:x1873176392993664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786400619.794836:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:15518:x1873176392993664:12345-0@lo:501:mount.lustre.0 Request processed in 227us (588us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400619.794844:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786400619.795034:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392993664:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1786400619.795050:0:15518:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786400619.795214:0:15518:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786400619.795222:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.795231:0:15518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b8f49600/0x49554f35ff0a6132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6139 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400619.795255:0:15518:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9373beb8b800 10000000:01000000:3.0:1786400619.795259:0:15518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786400619.795264:0:15518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1786400619.795266:0:15518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786400619.795270:0:15518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1786400619.795273:0:15518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786400619.795297:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763200/0x49554f35ff0a638c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.795304:0:15518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399763200/0x49554f35ff0a638c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.795313:0:15518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399763200/0x49554f35ff0a638c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400619.795338:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392993792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786400619.795368:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.795406:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1786400619.795522:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392993792 00000100:00100000:0.0:1786400619.795538:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392993792 00000100:00100000:0.0:1786400619.795573:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786400619.795580:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:15518:x1873176392993792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786400619.795589:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400619.795601:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a638c expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.795620:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a638c expref: 17 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.795630:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f49000/0x49554f35ff0a6393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a638c expref: 17 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.795638:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49000, rc 0) 00000100:00100000:0.0:1786400619.795668:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392993792:12345-0@lo:101:mount.lustre.0 Request processed in 89us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.795675:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786400619.795798:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392993792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786400619.795821:0:15518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399763200/0x49554f35ff0a638c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6393 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.795830:0:15518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399763200/0x49554f35ff0a638c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6393 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786400619.796482:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1786400619.798392:0:15518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400619.798827:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1786400619.798887:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1786400619.798921:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1786400619.798974:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1786400619.799012:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1786400619.799040:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1786400619.799103:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1786400619.799111:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1786400619.799197:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392993920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400619.799260:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.799297:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400619.802730:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392993920 00000100:00100000:0.0:1786400619.802782:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392993920 00000100:00100000:0.0:1786400619.802846:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786400619.802856:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392993920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400619.803413:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392993920:12345-0@lo:501:mount.lustre.0 Request processed in 558us (4152us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.803428:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786400619.804011:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392993920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400619.804066:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786400619.804115:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400619.804405:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392994048 00000100:00100000:2.0:1786400619.804411:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392994048 00000100:00100000:2.0:1786400619.804444:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1786400619.804452:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392994048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786400619.804937:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392994048:12345-0@lo:503:mount.lustre.0 Request processed in 485us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400619.804945:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786400619.805059:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786400619.805076:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786400619.805969:0:15518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786400619.806047:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786400619.806098:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.806130:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400619.806190:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392994176 00000100:00100000:2.0:1786400619.806196:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392994176 00000100:00100000:2.0:1786400619.806232:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1786400619.806240:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392994176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786400619.806448:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392994176:12345-0@lo:502:mount.lustre.0 Request processed in 208us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400619.806456:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786400619.806666:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786400619.806897:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1786400619.806947:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1786400619.806983:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1786400619.807032:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1786400619.807070:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1786400619.807120:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1786400619.807171:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1786400619.807206:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1786400619.807254:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1786400619.807283:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786400619.807956:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400619.808000:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400619.808474:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392994304 00000100:00100000:3.0:1786400619.808483:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392994304 00000100:00100000:3.0:1786400619.808536:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786400619.808546:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392994304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786400619.808779:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392994304:12345-0@lo:502:mount.lustre.0 Request processed in 234us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400619.808787:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786400619.809925:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786400619.810052:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1786400619.810067:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1786400619.811358:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786400619.811368:0:15519:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1786400619.811375:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400619.811443:0:15519:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1786400619.811451:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786400619.811466:0:15519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9373a0c519c0) 00000020:00000080:1.0:1786400619.811491:0:15519:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786400619.811497:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786400619.811625:0:15519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9373beb8b800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1786400619.811632:0:15519:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786400619.811639:0:15519:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x49554f35ff0a63a1 00010000:00010000:0.0:1786400619.817073:0:15519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1786400619.817622:0:15519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1786400619.827279:0:15519:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1786400619.837018:0:15519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1786400619.837037:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400619.837049:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400619.837052:0:15519:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1786400619.837057:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400619.837061:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400619.837062:0:15519:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786400619.837066:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786400619.837081:0:15519:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786400619.837085:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400619.837088:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400619.837089:0:15519:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1786400619.837091:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400619.837094:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400619.837095:0:15519:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786400619.837099:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1786400619.837168:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400619.837172:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400619.837174:0:15519:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1786400619.837177:0:15519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1786400619.840514:0:15518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1786400619.840622:0:15518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786400619.841043:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399763200/0x49554f35ff0a638c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6393 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.841057:0:15518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399763200/0x49554f35ff0a638c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6393 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400619.841067:0:15518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373beb8b800 from 1 10000000:01000000:3.0:1786400619.841069:0:15518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400619.841110:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.841118:0:15518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.841128:0:15518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400619.841152:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786400619.841219:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.841273:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1786400619.841296:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392994432 00000100:00100000:3.0:1786400619.841303:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392994432 00000100:00100000:3.0:1786400619.841362:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786400619.841371:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:15518:x1873176392994432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786400619.841391:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400619.841405:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a63a8 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.841429:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.841439:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.841448:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762e00, rc 0) 00000100:00100000:3.0:1786400619.841485:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994432:12345-0@lo:101:mount.lustre.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400619.841493:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786400619.841785:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786400619.841796:0:15518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.841803:0:15518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786400619.842301:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1786400619.845977:0:15518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400619.846269:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1786400619.846334:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1786400619.846622:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1786400619.846632:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1786400619.846719:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400619.846825:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.846867:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400619.847655:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392994560 00000100:00100000:0.0:1786400619.847665:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392994560 00000100:00100000:0.0:1786400619.847720:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786400619.847729:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400619.848000:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994560:12345-0@lo:501:mount.lustre.0 Request processed in 271us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.848009:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786400619.848195:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400619.848237:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786400619.848279:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.848314:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400619.849307:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392994688 00000100:00100000:0.0:1786400619.849314:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392994688 00000100:00100000:0.0:1786400619.849370:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786400619.849385:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786400619.849721:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994688:12345-0@lo:503:mount.lustre.0 Request processed in 336us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.849729:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786400619.851203:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786400619.851959:0:15518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786400619.852444:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786400619.852517:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.852603:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400619.853218:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392994816 00000100:00100000:0.0:1786400619.853226:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392994816 00000100:00100000:0.0:1786400619.853309:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786400619.853328:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786400619.853616:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994816:12345-0@lo:502:mount.lustre.0 Request processed in 298us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.853624:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786400619.853718:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786400619.854002:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1786400619.854079:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1786400619.854130:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1786400619.854168:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1786400619.854209:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1786400619.854258:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1786400619.854293:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1786400619.854336:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1786400619.854380:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786400619.854436:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400619.854862:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b049c780 going to sleep for 11 seconds 00000100:00100000:3.0:1786400619.854935:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392994944 00000100:00100000:3.0:1786400619.854942:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392994944 00000100:00100000:3.0:1786400619.854974:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786400619.854982:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786400619.855179:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392994944:12345-0@lo:502:mount.lustre.0 Request processed in 196us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400619.855187:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786400619.855360:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392994944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786400619.855491:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1786400619.855504:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1786400619.856727:0:15523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400619.856771:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400619.856775:0:15523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786400619.856783:0:15523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373beb8b800 00000020:00000080:1.0:1786400619.856786:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786400619.856793:0:15523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400619.856795:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400619.856797:0:15523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1786400619.856799:0:15523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400619.856802:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400619.856803:0:15523:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786400619.856806:0:15523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9373beb8b800 00000020:00000080:1.0:1786400619.856809:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786400619.856864:0:15523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400619.856868:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400619.856869:0:15523:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1786400619.856871:0:15523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400619.856880:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400619.856881:0:15523:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1786400619.856885:0:15523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9373beb8b800 00000020:00000080:1.0:1786400619.856887:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786400619.856926:0:15523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400619.856929:0:15523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400619.856931:0:15523:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1786400619.856934:0:15523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1786400619.863195:0:15518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1786400619.863242:0:15518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400619.863269:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.863294:0:15518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400619.863358:0:15518:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786400619.863361:0:15518:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9373beb8b800 10000000:01000000:3.0:1786400619.863364:0:15518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9373beb8b800 10000000:01000000:3.0:1786400619.863368:0:15518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786400619.863384:0:15518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9373beb8b800 from 1 10000000:01000000:3.0:1786400619.863387:0:15518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786400619.863427:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a63b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.863435:0:15518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a63b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.863446:0:15518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a63b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400619.863472:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786400619.863538:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.863577:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392995072 00000100:00100000:3.0:1786400619.863585:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392995072 00000100:00100000:3.0:1786400619.863633:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786400619.863643:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392995072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786400619.863656:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400619.863670:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399762800/0x49554f35ff0a63bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a63b6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.863702:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399762800/0x49554f35ff0a63bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a63b6 expref: 19 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.863712:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399762800/0x49554f35ff0a63bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a63b6 expref: 19 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.863720:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399762800, rc 0) 00000100:00100000:3.0:1786400619.863801:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995072:12345-0@lo:101:mount.lustre.0 Request processed in 159us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400619.863808:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786400619.863853:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400619.863874:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786400619.863887:0:15518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a63b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63bd expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400619.863895:0:15518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a63b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a63bd expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786400619.864512:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1786400619.864818:0:15518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400619.865061:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1786400619.865105:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1786400619.865137:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1786400619.865185:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1786400619.865221:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1786400619.865270:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1786400619.865305:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1786400619.865351:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1786400619.865409:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1786400619.865445:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1786400619.865480:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1786400619.865524:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1786400619.865560:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1786400619.865610:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1786400619.865655:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1786400619.865693:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1786400619.865726:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1786400619.865803:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1786400619.865838:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1786400619.865872:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1786400619.865918:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1786400619.865955:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1786400619.865987:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1786400619.866029:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1786400619.866063:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1786400619.866094:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1786400619.866136:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1786400619.866170:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1786400619.866200:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1786400619.866278:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1786400619.866314:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1786400619.871030:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1786400619.872301:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1786400619.872525:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1786400619.872567:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1786400619.872611:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1786400619.872645:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1786400619.872761:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1786400619.872769:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1786400619.872867:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400619.872946:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.872985:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400619.873493:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392995200 00000100:00100000:0.0:1786400619.873502:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392995200 00000100:00100000:0.0:1786400619.873556:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786400619.873567:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786400619.873828:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995200:12345-0@lo:501:mount.lustre.0 Request processed in 263us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.873836:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786400619.874305:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786400619.874358:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786400619.875229:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.875268:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400619.875759:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392995328 00000100:00100000:2.0:1786400619.875767:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392995328 00000100:00100000:2.0:1786400619.875813:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786400619.875821:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786400619.877760:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995328:12345-0@lo:503:mount.lustre.0 Request processed in 1918us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400619.877772:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786400619.879220:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995328:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786400619.879842:0:15518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786400619.879922:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786400619.879992:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.880042:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400619.881241:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392995456 00000100:00100000:2.0:1786400619.881252:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392995456 00000100:00100000:2.0:1786400619.881301:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786400619.881310:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786400619.881684:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995456:12345-0@lo:502:mount.lustre.0 Request processed in 373us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400619.881693:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786400619.882498:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786400619.882783:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1786400619.882840:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1786400619.882876:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1786400619.882924:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1786400619.882979:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1786400619.883025:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1786400619.885522:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1786400619.885608:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1786400619.885681:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1786400619.885720:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1786400619.885773:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1786400619.885826:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1786400619.885863:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1786400619.885897:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1786400619.885945:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1786400619.885995:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1786400619.886027:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1786400619.887259:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1786400619.887332:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1786400619.887369:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1786400619.888656:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1786400619.888699:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1786400619.888733:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1786400619.888802:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1786400619.888838:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1786400619.888872:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1786400619.888919:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1786400619.888956:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1786400619.888989:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1786400619.889034:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1786400619.889068:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1786400619.889101:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1786400619.889136:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1786400619.889184:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1786400619.889220:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1786400619.889273:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1786400619.896583:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1786400619.896678:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1786400619.896783:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1786400619.896821:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1786400619.896874:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786400619.896957:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.897001:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400619.897077:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392995584 00000100:00100000:2.0:1786400619.897085:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392995584 00000100:00100000:2.0:1786400619.897139:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786400619.897147:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786400619.897391:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392995584:12345-0@lo:502:mount.lustre.0 Request processed in 243us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400619.897400:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786400619.897555:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392995584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786400619.897629:0:15518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1786400619.897640:0:15518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1786400619.901046:0:15528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1786400619.901212:0:15528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9373b9c00000) 00000020:00000080:0.0:1786400619.901235:0:15528:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1786400619.901522:0:15528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9373beb8b800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1786400619.901527:0:15528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9373beb8b800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1786400619.901530:0:15528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9373beb8b800 3 00010000:00080000:0.0:1786400619.901560:0:15528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9373bf3f1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.123@tcp at head 00010000:00010000:0.0:1786400619.905531:0:15528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1786400619.905638:0:15528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1786400619.905677:0:15528:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786400619.905690:0:15528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x49554f35ff0a63cb 00000100:00080000:0.0:1786400619.905700:0:15528:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786400619.905705:0:15528:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9373bf3f1800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:0.0:1786400619.905782:0:15528:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937282722a00 x1873176392995712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786400619.905804:0:15528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786400619.905986:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1873176392995712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786400619.906067:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786400619.906149:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786400619.906153:0:10440:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1786400619.906156:0:10440:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786400619.906160:0:10440:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1786400619.906164:0:10440:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1786400619.906168:0:10440:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937386eec800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1786400619.906182:0:10440:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93728239e680 x1873176392995968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786400619.906228:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392995840:0@lo:400:kworker.0 00000100:00100000:3.0:1786400619.906259:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.906293:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392995968:0@lo:8:kworker.0 00000100:00100000:3.0:1786400619.906315:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400619.906359:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392995840 00000100:00100000:3.0:1786400619.906367:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392995840 00000100:00100000:3.0:1786400619.907195:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392995968 00000100:00100000:3.0:1786400619.907200:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392995968 00000100:00100000:3.0:1786400619.907214:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786400619.907223:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392995840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400619.907283:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392995840:12345-0@lo:400:kworker.0 Request processed in 61us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400619.907290:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786400619.907305:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400619.907309:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1873176392995968:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1786400619.907366:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1873176392995968:12345-0@lo:8:kworker.0 Request processed in 54us (1049us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786400619.908510:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392995712 00000100:00100000:0.0:1786400619.908527:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392995712 00000100:00100000:0.0:1786400619.908560:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400619.908565:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1873176392995712:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1786400619.908587:0:14211:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:0.0:1786400619.908645:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x49554f35ff0a63d2 00000004:00100000:0.0:1786400619.908660:0:14211:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786400619.908691:0:14211:0:(import.c:65:import_set_state_nolock()) ffff93728323b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400619.908761:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873176392995712:12345-0@lo:38:llog_process_th.0 Request processed in 193us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.908768:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400619.908836:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1786400619.908856:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400619.909769:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392996096:0@lo:400:kworker.0 00000100:00100000:2.0:1786400619.909816:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400619.909851:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400619.909858:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392996224:0@lo:400:kworker.0 00000100:00100000:2.0:1786400619.909881:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400619.909919:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392996096 00000100:00100000:2.0:1786400619.909924:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392996096 00000100:00100000:2.0:1786400619.909952:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392996224 00000100:00100000:2.0:1786400619.909955:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392996224 00000100:00100000:2.0:1786400619.909992:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786400619.909998:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392996096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400619.910039:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176392996096:12345-0@lo:400:kworker.0 Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400619.910046:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786400619.910453:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786400619.910462:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392996224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400619.910493:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392996224:12345-0@lo:400:kworker.0 Request processed in 33us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400619.910499:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1786400619.910516:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786400619.910541:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93728239d500 x1873176392996224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400619.910553:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392996224:0@lo:400:kworker.0 00010000:00080000:2.0:1786400619.910564:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93728239df80 x1873176392996096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400619.910572:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176392996096:0@lo:400:kworker.0 00000100:00100000:3.0:1786400619.912126:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1786400619.912148:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392995840:0@lo:400:kworker.0 00000100:00100000:3.0:1786400619.912177:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786400619.912182:0:3314:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786400619.912187:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786400619.912190:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392995968:0@lo:8:kworker.0 00010000:00080000:3.0:1786400619.912204:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937282722a00 x1873176392995712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400619.912213:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786400619.912220:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1786400619.912227:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1786400619.912232:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786400619.912235:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9373bf3f1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786400619.912241:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1873176392995712:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1786400619.912616:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1786400619.914507:0:15518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1786400619.914551:0:15518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786400619.914572:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a63b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63bd expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.914584:0:15518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff937399762400/0x49554f35ff0a63b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63bd expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786400619.914639:0:15518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786400619.914641:0:15518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786400619.914642:0:15518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400619.914644:0:15518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400619.914645:0:15518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400619.914646:0:15518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400619.914649:0:15518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400619.914650:0:15518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400619.914652:0:15518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786400619.914657:0:15518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1786400619.914659:0:15518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786400619.914661:0:15518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786400619.914662:0:15518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400619.914663:0:15518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400619.914669:0:15518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400619.914670:0:15518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400619.914671:0:15518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400619.914672:0:15518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400619.914673:0:15518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786400619.914702:0:15518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1786400619.914722:0:15518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392996352:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786400619.914809:0:15518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400619.914855:0:15518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400619.915547:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392996352 00000100:00100000:2.0:1786400619.915555:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392996352 00000100:00100000:2.0:1786400619.915614:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786400619.915624:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:15518:x1873176392996352:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786400619.915653:0:14203:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1786400619.915667:0:14203:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786400619.976514:0:14203:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786400619.976533:0:14203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1786400619.976595:0:14227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786400619.976600:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786400619.976622:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400619.976640:0:14227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 19 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400619.976648:0:14227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400619.976685:0:14227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 19 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400619.976700:0:14227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 19 pid: 14204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400619.976714:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14227:1873176392996480:0@lo:104: 00000100:00100000:1.0:1786400619.976820:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400619.976857:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373840b83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400619.976922:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392996480 00000100:00100000:0.0:1786400619.976930:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392996480 00000100:00100000:0.0:1786400619.976982:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400619.976992:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:14227:x1873176392996480:12345-0@lo:104: 00010000:00010000:0.0:1786400619.977007:0:14195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.977068:0:14195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786400619.977074:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:14227:x1873176392996480:12345-0@lo:104: Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.977082:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1786400619.977103:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400619.977110:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.977117:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:0.0:1786400619.977121:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.977130:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400619.977148:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400619.977154:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786400619.977177:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.977184:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400619.977199:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.977207:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399763a00/0x49554f35ff0a62ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a62b3 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.977222:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400619.977224:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400619.977226:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400619.977299:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14227:1873176392996480:0@lo:104: 00010000:00010000:1.0:1786400619.977328:0:14227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400619.977481:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176392996608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400619.977515:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400619.978224:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392996608 00000100:00100000:0.0:1786400619.978231:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392996608 00010000:00010000:0.0:1786400619.978258:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 20 pid: 14204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400619.978292:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400619.978299:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+20:3315:x1873176392996608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400619.978311:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400619.978327:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 20 pid: 14204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978339:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 20 pid: 14204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978363:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a62b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a62ac expref: 20 pid: 14204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978377:0:14198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978385:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786400619.978399:0:14198:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001799703s 00010000:00010000:0.0:1786400619.978403:0:14198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978410:0:14198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978417:0:14198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978424:0:14198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978430:0:14198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400619.978435:0:14198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.978442:0:14198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400619.985920:0:14227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400619.985941:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.986434:0:14198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.986461:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373bfebf600/0x49554f35ff0a63d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400619.986482:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400619.986564:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3315:x1873176392996608:12345-0@lo:103:ldlm_bl.0 Request processed in 8260us (9043us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400619.986574:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400619.986734:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176392996608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400619.991060:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:15518:x1873176392996352:12345-0@lo:253:mount.lustre.0 Request processed in 75428us (76241us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400619.991074:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786400619.991182:0:15518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:15518:1873176392996352:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786400619.991198:0:15518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786400619.991201:0:15518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786400619.991203:0:15518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786400619.991204:0:15518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786400619.991205:0:15518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786400619.991207:0:15518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786400619.991208:0:15518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786400619.991209:0:15518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786400619.991211:0:15518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786400619.991212:0:15518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1786400619.991230:0:15518:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1786400619.998546:0:15518:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400620.004795:0:15518:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1786400620.005004:0:15518:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400620.005175:0:15518:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1786400620.005337:0:15518:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400620.007666:0:15518:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1786400620.010602:0:15518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1786400620.101462:0:15518:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1786400620.101472:0:15518:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1786400620.101507:0:15518:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786400620.101588:0:15518:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786400620.101602:0:15518:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1786400620.101631:0:15518:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1786400620.115962:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400621.139071:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786400621.204591:0:14208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786400621.204599:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff937399fd8000 from 8 10000000:01000000:1.0:1786400621.204604:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786400621.204652:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebe000/0x49554f35ff0a63e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400621.204665:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373bfebe000/0x49554f35ff0a63e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400621.204675:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373bfebe000/0x49554f35ff0a63e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400621.204701:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392996736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400621.204798:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400621.204853:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b07336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400621.207929:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392996736 00000100:00100000:3.0:1786400621.207944:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392996736 00000100:00100000:3.0:1786400621.208171:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786400621.208182:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:14208:x1873176392996736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400621.208200:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400621.208219:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937399763400/0x49554f35ff0a63e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a63e0 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400621.208247:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937399763400/0x49554f35ff0a63e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a63e0 expref: 19 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400621.208258:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937399763400/0x49554f35ff0a63e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a63e0 expref: 19 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400621.208267:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937399763400, rc 0) 00000100:00100000:3.0:1786400621.208389:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:14208:x1873176392996736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400621.208559:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786400621.210668:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392996736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400621.210693:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373bfebe000/0x49554f35ff0a63e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63e7 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400621.210705:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373bfebe000/0x49554f35ff0a63e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a63e7 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400621.210801:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392996864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1786400621.210861:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400621.210913:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d86240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400621.210947:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392996864 00000100:00100000:0.0:1786400621.210953:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392996864 00000100:00100000:0.0:1786400621.210995:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786400621.211003:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:14208:x1873176392996864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786400621.211022:0:14203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786400621.211038:0:14203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786400621.211041:0:14203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1786400621.215899:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:14208:x1873176392996864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 4887us (5028us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400621.215913:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786400621.229865:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176392996864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1786400621.229952:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786400621.229966:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bfebe000/0x49554f35ff0a63e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63e7 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400621.229977:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373bfebe000/0x49554f35ff0a63e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a63e7 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400621.460262:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400621.460285:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392996992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400621.460378:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400621.460448:0:14852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392996992 00000100:00100000:0.0:1786400621.460456:0:14852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392996992 00000100:00100000:0.0:1786400621.460516:0:14852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786400621.460526:0:14852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392996992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400621.460569:0:14852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400621.460613:0:14852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176392996992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400621.460628:0:14852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1786400621.460652:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400621.460691:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392996992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786400622.165345:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400623.188508:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786400623.635565:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786400624.214451:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786400625.054848:0:10440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786400625.054892:0:10440:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1786400625.054896:0:10440:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786400625.054909:0:10440:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937386eec800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1786400625.054934:0:10440:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9373b7720380 x1873176392997376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786400625.054996:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392997504:0@lo:400:kworker.0 00000100:00100000:3.0:1786400625.055149:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3317:1873176392997120:0@lo:400:kworker.0 00000100:00100000:2.0:1786400625.055272:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392997248:0@lo:400:kworker.0 00000100:00100000:3.0:1786400625.060096:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400625.060173:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392997760:0@lo:400:kworker.0 00000100:00100000:3.0:1786400625.060208:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400625.060277:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392997376:0@lo:8:kworker.0 00000100:00100000:3.0:1786400625.060310:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400625.060350:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392997120 00000100:00100000:3.0:1786400625.060360:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392997760 00000100:00100000:0.0:1786400625.060360:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392997120 00000100:00100000:3.0:1786400625.060363:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392997760 00000100:00100000:3.0:1786400625.060405:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786400625.060409:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786400625.060413:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392997760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400625.060415:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3317:x1873176392997120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400625.060460:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3317:x1873176392997120:12345-0@lo:400:kworker.0 Request processed in 45us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400625.060461:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176392997760:12345-0@lo:400:kworker.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400625.060468:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786400625.060468:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786400625.060489:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392997376 00000100:00100000:3.0:1786400625.060492:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392997376 00000100:00100000:3.0:1786400625.060525:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400625.060530:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1873176392997376:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1786400625.060553:0:14849:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:3.0:1786400625.060592:0:14849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49554f35ff0a63ee 00002000:00100000:3.0:1786400625.060606:0:14849:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9373c1ed2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1786400625.060610:0:14849:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1786400625.060612:0:14849:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786400625.061306:0:14849:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786400625.061332:0:14849:0:(import.c:65:import_set_state_nolock()) ffff9373c1ed3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786400625.061394:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1873176392997376:12345-0@lo:8:kworker.0 Request processed in 862us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400625.061401:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1786400625.061425:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400625.061450:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3317:1873176392997120:0@lo:400:kworker.0 00010000:00080000:0.0:1786400625.061450:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7720380 x1873176392997376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786400650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1786400625.061461:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7720a80 x1873176392997760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786400625.061464:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00100000:3.0:1786400625.061469:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176392997760:0@lo:400:kworker.0 00000100:00080000:0.0:1786400625.061472:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786400625.061477:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1786400625.061479:0:3314:0:(import.c:65:import_set_state_nolock()) ffff937386eec800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786400625.061492:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786400625.061496:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1873176392997376:0@lo:8:kworker.0 00000004:00080000:0.0:1786400625.061513:0:14235:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786400625.061540:0:14236:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1786400625.061625:0:14236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14236:1873176392998016:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1786400625.061656:0:14236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400625.061675:0:14236:0:(client.c:2702:ptlrpc_set_wait()) set ffff93738d7bd780 going to sleep for 11 seconds 00000100:00100000:3.0:1786400625.061690:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392998016 00000100:00100000:3.0:1786400625.061694:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392998016 00000100:00100000:3.0:1786400625.061725:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400625.061731:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14236:x1873176392998016:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1786400625.061878:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400625.061903:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400625.061910:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392997632:0@lo:400:kworker.0 00000100:00100000:1.0:1786400625.061935:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1786400625.061936:0:14235:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 546803195902ns, next at 0ns, rc = 0 00000100:00100000:1.0:1786400625.061961:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392997504 00000100:00100000:1.0:1786400625.061965:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392997504 00000100:00100000:1.0:1786400625.061985:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392997632 00000100:00100000:1.0:1786400625.061988:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392997632 00000100:00100000:1.0:1786400625.062003:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786400625.062009:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392997504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400625.062060:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392997504:12345-0@lo:400:kworker.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400625.062066:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786400625.062079:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786400625.062085:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392997632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400625.062108:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392997632:12345-0@lo:400:kworker.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400625.062114:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1786400625.062138:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7722300 x1873176392997632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400625.062161:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392997632:0@lo:400:kworker.0 00010000:00080000:1.0:1786400625.062173:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9373b7723800 x1873176392997504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400625.062181:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392997504:0@lo:400:kworker.0 00000100:00080000:3.0:1786400625.066220:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786400625.066242:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400625.066257:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400625.066286:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93728239d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392997888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400625.066391:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400625.068227:0:14852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392997888 00000100:00100000:0.0:1786400625.068252:0:14852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392997888 00000100:00100000:0.0:1786400625.068322:0:14852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400625.068331:0:14852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1873176392997888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400625.068363:0:14852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400625.068452:0:14852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1873176392997888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400625.068459:0:14852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400625.068641:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1786400625.073310:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93728239d500 x1873176392997888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400625.073336:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176392997888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400625.073372:0:14849:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1786400625.073380:0:14849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1786400625.074626:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392997248 00000100:00100000:0.0:1786400625.074636:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392997248 00000100:00080000:3.0:1786400625.074665:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400625.074695:0:14850:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1786400625.074704:0:14849:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1786400625.074707:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400625.074716:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392997248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400625.075943:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392997248:12345-0@lo:400:kworker.0 Request processed in 1221us (7295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400625.075956:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400625.077833:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392997248:0@lo:400:kworker.0 00002000:00080000:2.0:1786400625.088327:0:14851:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1786400625.088339:0:14851:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1786400625.088344:0:14851:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000004:00080000:1.0:1786400625.097480:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1786400625.115593:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400625.115606:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.115622:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=546s v=(0 0) 00010000:00010000:2.0:1786400625.115626:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400625.115632:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.115649:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.115659:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.115667:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.115699:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786400625.115788:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400625.115795:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.115803:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102ea00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400625.115808:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.115817:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.115834:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.115840:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a63f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.115868:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.115875:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.115876:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400625.116384:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400625.116390:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.116400:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=546s v=(0 0) 00010000:00010000:2.0:1786400625.116403:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400625.116407:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.116417:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.116426:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.116434:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.116456:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786400625.117143:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.117151:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117161:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.117164:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.117169:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117187:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117195:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117202:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117226:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786400625.117626:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.117632:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117641:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.117644:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.117648:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117657:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117664:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117684:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.117692:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1786400625.118125:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.118131:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118141:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.118144:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.118148:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118158:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118167:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118176:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118184:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1786400625.118423:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1786400625.118432:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118440:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102fa00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.118445:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118467:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118486:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118493:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a63fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118513:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786400625.118517:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118523:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763600 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.118527:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118535:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118544:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118551:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cd2bb12/0x49554f35ff0a6403 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400625.118582:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400625.118585:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786400625.118588:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118588:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118595:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763000 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.118598:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118600:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.118603:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400625.118606:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118607:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118618:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118618:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118626:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e7fcaf2/0x49554f35ff0a640a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118627:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118635:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118637:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400625.118640:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.118642:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400625.118645:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763e00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.118648:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118665:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118675:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118682:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e616267/0x49554f35ff0a6411 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118694:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400625.118697:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118703:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763c00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.118706:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118714:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118723:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118730:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd906197/0x49554f35ff0a6418 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.118910:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.118912:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.118913:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786400625.119037:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.119044:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119051:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.119054:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.119058:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119068:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119086:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119093:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119118:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786400625.119509:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.119515:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119524:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.119527:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.119532:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119543:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119551:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119560:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.119580:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786400625.119997:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.120003:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.120013:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.120016:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.120020:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.120030:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.120038:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.120046:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.120055:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1786400625.120394:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786400625.120401:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120409:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762200 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.120413:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120420:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120435:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120442:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f434bb8/0x49554f35ff0a641f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120457:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786400625.120460:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120466:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399763a00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.120475:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120483:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120492:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120499:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f73aa10/0x49554f35ff0a6426 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120511:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400625.120514:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120519:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762a00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.120522:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120528:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120537:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120543:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c6a5e45/0x49554f35ff0a642d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.120632:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.120634:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.120636:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.121833:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786400625.129104:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.129121:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129139:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.129150:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.129157:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129172:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129181:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129190:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129216:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400625.129353:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400625.129361:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.129369:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f000 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.129374:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.129384:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.129403:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.129410:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099c6e44b/0x49554f35ff0a6434 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.129430:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.129432:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.129434:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786400625.129903:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.129911:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129922:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.129925:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.129930:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129941:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129950:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.129966:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.130021:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786400625.130442:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.130448:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.130457:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.130460:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.130465:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.130474:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.130483:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.130490:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.134902:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400625.134916:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.134929:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fa00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400625.134935:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.134945:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.134966:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.134974:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a122d2e6/0x49554f35ff0a643b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.134996:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400625.134999:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.135006:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e600 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400625.135008:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.135031:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.135041:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.135048:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.135050:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.135051:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400625.135252:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786400625.135260:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fb9115d/0x49554f35ff0a6442 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.135794:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786400625.137273:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.137284:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.137300:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.137305:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.137311:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.137326:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.137337:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.137344:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.137408:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786400625.140022:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.140037:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.140052:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.140055:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.140069:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.140082:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.140092:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.140099:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144408:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400625.144423:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144438:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ec00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400625.144443:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144453:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144474:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144481:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fedd7b27/0x49554f35ff0a6449 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144518:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400625.144522:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144528:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400625.144531:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144538:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144546:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.144552:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.144554:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.144556:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400625.147573:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786400625.147589:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000919765a4/0x49554f35ff0a6450 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400625.148333:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.148342:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.148356:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.148361:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.148368:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.148382:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.148404:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.148412:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.153406:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400625.153428:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.153444:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400625.153450:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.153477:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.153507:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.153516:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.153517:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.153519:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400625.153967:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786400625.153976:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd9c491d/0x49554f35ff0a6457 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400625.154668:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.154677:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.154690:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.154710:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.154717:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.154731:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.154772:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.154792:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.154815:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786400625.155224:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.155244:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155252:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.155255:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.155259:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155267:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155274:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155280:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155287:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786400625.155649:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.155655:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155667:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.155670:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.155673:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155682:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155689:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155696:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.155703:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1786400625.156106:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.156113:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156121:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.156124:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.156128:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156137:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156156:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156163:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156171:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1786400625.156581:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.156587:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156595:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.156598:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.156602:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156610:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156618:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156626:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.156645:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1786400625.157067:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.157073:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.157082:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.157085:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.157090:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.157099:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.157107:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.157113:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.157121:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1786400625.157339:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1786400625.157347:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157356:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.157361:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157371:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157391:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157399:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de5f9078/0x49554f35ff0a645e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157433:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1786400625.157437:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157444:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fc00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.157447:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157454:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157465:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157472:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af8a1eed/0x49554f35ff0a6465 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157482:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786400625.157486:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157491:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f400 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.157494:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157510:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157519:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157526:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000508ab1b2/0x49554f35ff0a646c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157539:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786400625.157542:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157548:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ee00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.157551:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157558:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157566:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157573:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027b17f64/0x49554f35ff0a6473 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157595:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786400625.157598:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157604:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1ea00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.157608:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157615:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157623:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157630:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f17d8154/0x49554f35ff0a647a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157639:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400625.157642:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157648:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1fe00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.157651:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157668:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157678:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157685:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5fd7a01/0x49554f35ff0a6481 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.157697:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400625.157699:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400625.157701:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400625.157971:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786400625.162518:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400625.162530:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.162546:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1786400625.162555:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400625.162562:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.162577:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.162587:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.162594:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400625.163755:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786400625.164969:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400625.164981:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.165006:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=546s v=(0 0) 00010000:00010000:2.0:1786400625.165010:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400625.165016:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.165029:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.165039:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.165047:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.165981:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786400625.166104:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400625.166112:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166122:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1e800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400625.166127:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166149:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166167:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166174:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015e2b575/0x49554f35ff0a6488 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166203:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400625.166206:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166211:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102fa00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:1.0:1786400625.166214:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166222:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166244:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166250:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf8e759/0x49554f35ff0a648f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400625.166262:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.166264:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.166266:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400625.166462:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400625.166469:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.166477:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=546s v=(0 0) 00010000:00010000:2.0:1786400625.166481:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400625.166486:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.166496:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.166514:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.166521:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.166531:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786400625.167023:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400625.167031:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.167040:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102ec00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.167043:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.167052:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.167064:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.167081:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba5767d/0x49554f35ff0a6496 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400625.167110:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400625.167118:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.167127:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=546s v=(0 0) 00010000:00010000:2.0:1786400625.167130:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400625.167134:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.167142:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.167150:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.167157:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.167177:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.167178:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.167180:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.167198:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786400625.168367:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400625.168377:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.168389:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=546s v=(0 0) 00010000:00010000:2.0:1786400625.168393:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400625.168398:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.168408:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.168417:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.168424:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.168448:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1786400625.168975:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786400625.168982:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.168991:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102ea00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.168995:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400625.169000:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786400625.169004:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169006:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169020:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169023:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=546s v=(0 0) 00010000:00010000:2.0:1786400625.169027:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400625.169028:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032967510/0x49554f35ff0a649d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169032:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169041:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169045:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400625.169048:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169049:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169056:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102f000 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.169058:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169063:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169066:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786400625.169072:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169083:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169091:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e7823d1/0x49554f35ff0a64a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169103:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400625.169106:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169114:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102e600 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:0.0:1786400625.169118:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169126:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169136:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169144:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027895b19/0x49554f35ff0a64ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400625.169161:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400625.169162:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400625.169164:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400625.169253:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786400625.169451:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400625.169458:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169465:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=546s v=(0 0) 00010000:00010000:2.0:1786400625.169468:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400625.169472:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169481:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169499:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169507:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169523:0:14851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400625.169531:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400625.169535:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169542:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102f800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400625.169545:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169553:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169564:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169570:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567b4dce/0x49554f35ff0a64b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400625.169583:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.169588:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400625.169590:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1786400625.170798:0:14851:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1786400625.170903:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14236:x1873176392998016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 109166us (109241us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400625.170914:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400625.171065:0:14236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93728239f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14236:1873176392998016:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786400625.171086:0:14236:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1786400625.171141:0:14236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14236:1873176392998144:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1786400625.171188:0:14236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400625.171254:0:14236:0:(client.c:2702:ptlrpc_set_wait()) set ffff937399f2ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400625.173769:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392998144 00000100:00100000:2.0:1786400625.173783:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392998144 00000100:00100000:2.0:1786400625.173838:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786400625.173847:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14236:x1873176392998144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1786400625.173898:0:14849:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1786400625.192996:0:14236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14236:1873176392998144:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786400625.193017:0:14236:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1786400625.193058:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14236:x1873176392998144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19007us (21663us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1786400625.193069:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1786400625.236116:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400626.258842:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400626.585212:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400626.585239:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392998272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400626.585362:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400626.591331:0:14852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392998272 00000100:00100000:3.0:1786400626.591347:0:14852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392998272 00000100:00100000:3.0:1786400626.591411:0:14852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400626.591421:0:14852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392998272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400626.591472:0:14852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400626.591558:0:14852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392998272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (6196us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400626.591565:0:14852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400626.591627:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392998272:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1786400626.825614:0:15874:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1786400627.283109:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400628.306871:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400629.338004:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400629.500873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400629.500998:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368882560 00000100:00100000:0.0:1786400629.501011:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368882560 00000100:00100000:0.0:1786400629.501081:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:0.0:1786400629.501090:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2358:x1873176368882560:12345-192.168.201.23@tcp:250:mount.lustre.0 00010000:00080000:0.0:1786400629.501123:0:14203:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e@192.168.201.23@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1786400629.501166:0:14203:0:(genops.c:1406:class_connect()) connect: client 94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e, cookie 0x49554f35ff0a64b9 00000100:00080000:0.0:1786400629.501324:0:14203:0:(import.c:65:import_set_state_nolock()) ffff93728323f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400629.501407:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+5:2358:x1873176368882560:12345-192.168.201.23@tcp:250:mount.lustre.0 Request processed in 316us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400629.501415:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:0.0:1786400629.513618:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400629.517537:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368882688 00000100:00100000:2.0:1786400629.517555:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368882688 00000100:00100000:2.0:1786400629.517642:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:2.0:1786400629.517653:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937399e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+5:13714:x1873176368882688:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786400629.517670:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400629.517693:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93739102f200/0x49554f35ff0a64c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5469 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400629.517729:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93739102f200/0x49554f35ff0a64c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5469 expref: 6 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400629.517784:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93739102f200/0x49554f35ff0a64c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5469 expref: 6 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400629.517812:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102f200, rc 0) 00000100:00100000:2.0:1786400629.517876:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937399e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+6:13714:x1873176368882688:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 224us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400629.517883:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:3.0:1786400629.533098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400629.534105:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368882816 00000100:00100000:1.0:1786400629.534120:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368882816 00000100:00100000:1.0:1786400629.534198:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:1.0:1786400629.534209:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+6:13714:x1873176368882816:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1786400629.534538:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+6:13714:x1873176368882816:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 331us (1449us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786400629.534548:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:1.0:1786400629.547927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400629.548025:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368882944 00000100:00100000:0.0:1786400629.548034:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368882944 00000100:00100000:0.0:1786400629.548090:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:0.0:1786400629.548099:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+6:13714:x1873176368882944:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786400629.548116:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400629.548133:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a64c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5470 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400629.548175:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a64c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5470 expref: 7 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400629.548213:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f48800/0x49554f35ff0a64c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5470 expref: 7 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400629.548224:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f48800, rc 0) 00000100:00100000:0.0:1786400629.548774:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+7:13714:x1873176368882944:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 640us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400629.548782:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:0.0:1786400629.555115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400629.555838:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368883072 00000100:00100000:2.0:1786400629.555849:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368883072 00000100:00100000:2.0:1786400629.555911:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:2.0:1786400629.555922:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+7:13714:x1873176368883072:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786400629.556199:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+8:13714:x1873176368883072:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 278us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400629.556217:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:2.0:1786400629.582322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400629.582425:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368883200 00000100:00100000:0.0:1786400629.582436:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368883200 00000100:00100000:0.0:1786400629.582596:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:0.0:1786400629.582608:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+8:13714:x1873176368883200:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786400629.582975:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+8:13714:x1873176368883200:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 368us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400629.582983:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:3.0:1786400629.587968:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400629.597935:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368883328 00000100:00100000:2.0:1786400629.597951:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368883328 00000100:00100000:2.0:1786400629.598018:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:2.0:1786400629.598028:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+8:13732:x1873176368883328:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400629.598618:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+8:13732:x1873176368883328:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 588us (10656us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400629.598627:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:3.0:1786400629.623868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400629.624059:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368883456 00000100:00100000:2.0:1786400629.624070:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368883456 00000100:00100000:2.0:1786400629.624121:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:2.0:1786400629.624131:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+8:13732:x1873176368883456:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400629.624540:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+8:13732:x1873176368883456:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 340us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400629.624556:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:2.0:1786400629.651951:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400629.652221:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368883584 00000100:00100000:1.0:1786400629.652232:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368883584 00000100:00100000:1.0:1786400629.652288:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:1.0:1786400629.652298:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+8:13714:x1873176368883584:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786400629.652316:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400629.652334:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebee00/0x49554f35ff0a64ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f549a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400629.652362:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebee00/0x49554f35ff0a64ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f549a expref: 9 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400629.652393:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebee00/0x49554f35ff0a64ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f549a expref: 9 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400629.652403:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebee00, rc 0) 00000100:00100000:1.0:1786400629.652460:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+9:13714:x1873176368883584:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 163us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400629.652477:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:1.0:1786400629.658718:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400629.658870:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368883712 00000100:00100000:0.0:1786400629.658880:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368883712 00000100:00100000:0.0:1786400629.658954:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:0.0:1786400629.658974:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+9:13714:x1873176368883712:12345-192.168.201.23@tcp:256:mount.lustre.0 20000000:01000000:0.0:1786400629.659000:0:14203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1786400629.659024:0:14203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1786400629.659028:0:14203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1786400629.659031:0:14203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1786400629.659033:0:14203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1786400629.664880:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+9:13714:x1873176368883712:12345-192.168.201.23@tcp:256:mount.lustre.0 Request processed in 5905us (6159us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400629.664918:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:2.0:1786400629.672869:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400629.673035:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368883840 00000100:00100000:0.0:1786400629.673047:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368883840 00000100:00100000:0.0:1786400629.673378:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:0.0:1786400629.673390:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+9:13714:x1873176368883840:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786400629.673406:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400629.673425:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f54a1 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400629.673456:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 10 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400629.673467:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 10 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400629.673476:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b8f49200, rc 0) 00000100:00100000:0.0:1786400629.673544:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13714:x1873176368883840:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 157us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400629.673551:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:3.0:1786400629.676564:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400629.678209:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368883968 00000100:00100000:1.0:1786400629.678224:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368883968 00000100:00100000:1.0:1786400629.678277:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:1.0:1786400629.678287:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13714:x1873176368883968:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1786400629.678614:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13714:x1873176368883968:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 326us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400629.678622:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:3.0:1786400629.681335:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400629.681548:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368884096 00000100:00100000:1.0:1786400629.681559:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368884096 00000100:00100000:1.0:1786400629.681602:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:1.0:1786400629.681610:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13714:x1873176368884096:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:1.0:1786400629.681939:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13714:x1873176368884096:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 328us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400629.681947:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:3.0:1786400629.685166:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400629.685866:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368884224 00000100:00100000:1.0:1786400629.685877:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368884224 00000100:00100000:1.0:1786400629.685943:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:1.0:1786400629.685970:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13737:x1873176368884224:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400629.686567:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13737:x1873176368884224:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 597us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400629.686576:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:3.0:1786400629.688526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400629.688626:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368884352 00000100:00100000:2.0:1786400629.688635:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368884352 00000100:00100000:2.0:1786400629.688701:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:2.0:1786400629.688711:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13737:x1873176368884352:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400629.689163:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13737:x1873176368884352:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 440us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400629.689171:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:3.0:1786400629.696031:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400629.696483:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368884480 00000100:00100000:1.0:1786400629.696493:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368884480 00000100:00100000:1.0:1786400629.696536:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:1.0:1786400629.696545:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1873176368884480:12345-192.168.201.23@tcp:38:mount.lustre.0 00010000:00080000:1.0:1786400629.696575:0:14213:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 96fe1f16-deaa-49ac-af27-b01352c851d6@192.168.201.23@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:1.0:1786400629.696631:0:14213:0:(genops.c:1406:class_connect()) connect: client 96fe1f16-deaa-49ac-af27-b01352c851d6, cookie 0x49554f35ff0a64dc 00000004:00100000:1.0:1786400629.696675:0:14213:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1786400629.696681:0:14213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1786400629.775322:0:14213:0:(import.c:65:import_set_state_nolock()) ffff9373c1ed5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786400629.775457:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2358:x1873176368884480:12345-192.168.201.23@tcp:38:mount.lustre.0 Request processed in 78909us (79433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400629.775470:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:1.0:1786400629.780979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400629.781329:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368884608 00000100:00100000:3.0:1786400629.781339:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368884608 00000100:00100000:3.0:1786400629.781413:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:3.0:1786400629.781425:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+6:0:x1873176368884608:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786400629.781471:0:14212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786400629.781551:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+6:0:x1873176368884608:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 128us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400629.781559:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00080000:2.0:1786400629.782173:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400629.786299:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400629.786430:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368884736 00000100:00100000:3.0:1786400629.786441:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368884736 00000100:00100000:3.0:1786400629.786596:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1786400629.786608:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+6:13714:x1873176368884736:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786400629.786639:0:14213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786400629.786913:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+6:13714:x1873176368884736:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 307us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400629.786938:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:0.0:1786400629.789139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400629.789310:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368884864 00000100:00100000:3.0:1786400629.789321:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368884864 00000100:00100000:3.0:1786400629.789410:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1786400629.789422:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:13714:x1873176368884864:12345-192.168.201.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1786400629.789522:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:13714:x1873176368884864:12345-192.168.201.23@tcp:40:mount.lustre.0 Request processed in 102us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400629.789531:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:1.0:1786400629.791625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400629.791860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400629.792007:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368884992 00000100:00100000:3.0:1786400629.792015:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368884992 00000100:00100000:3.0:1786400629.792052:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1786400629.792059:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873176368884992:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:3.0:1786400629.792090:0:14850:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 96fe1f16-deaa-49ac-af27-b01352c851d6@192.168.201.23@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:3.0:1786400629.792121:0:14850:0:(genops.c:1406:class_connect()) connect: client 96fe1f16-deaa-49ac-af27-b01352c851d6, cookie 0x49554f35ff0a64e3 00002000:00100000:3.0:1786400629.792134:0:14850:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 96fe1f16-deaa-49ac-af27-b01352c851d6/ffff9373c1ed2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786400629.792169:0:14850:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786400629.792507:0:14850:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786400629.792536:0:14850:0:(import.c:65:import_set_state_nolock()) ffff9373c1ed4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786400629.792606:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2358:x1873176368884992:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 545us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400629.792614:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:2.0:1786400629.795417:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368885248 00000100:00100000:2.0:1786400629.795431:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368885248 00000100:00100000:2.0:1786400629.795591:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:2.0:1786400629.795603:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:13714:x1873176368885248:12345-192.168.201.23@tcp:33:mount.lustre.0 00000100:00100000:0.0:1786400629.798615:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400629.798794:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368885120 00000100:00100000:3.0:1786400629.798803:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368885120 00000100:00100000:3.0:1786400629.798842:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:3.0:1786400629.798850:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1873176368885120:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:3.0:1786400629.798906:0:15790:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 96fe1f16-deaa-49ac-af27-b01352c851d6@192.168.201.23@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:3.0:1786400629.798935:0:15790:0:(genops.c:1406:class_connect()) connect: client 96fe1f16-deaa-49ac-af27-b01352c851d6, cookie 0x49554f35ff0a64ea 00002000:00100000:3.0:1786400629.798946:0:15790:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 96fe1f16-deaa-49ac-af27-b01352c851d6/ffff9373c1ed1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786400629.798966:0:15790:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786400629.799125:0:15790:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786400629.799162:0:15790:0:(import.c:65:import_set_state_nolock()) ffff9373beb88800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786400629.799232:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2358:x1873176368885120:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 381us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400629.799240:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000004:00080000:1.0:1786400629.803809:0:14214:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7950us 00000004:00200000:0.0:1786400629.821068:0:14214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1786400629.821287:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:13714:x1873176368885248:12345-192.168.201.23@tcp:33:mount.lustre.0 Request processed in 25681us (29664us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400629.821301:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:0.0:1786400629.975527:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400629.975639:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368885376 00000100:00100000:3.0:1786400629.975650:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368885376 00000100:00100000:3.0:1786400629.975722:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1786400629.975733:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+6:13757:x1873176368885376:12345-192.168.201.23@tcp:101:mkdir.0 00010000:00010000:3.0:1786400629.975807:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400629.975834:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a64f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f54cb expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400629.976156:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a64f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400629.976171:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a64f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400629.976185:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a64f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400629.976387:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786400629.976397:0:14213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400629.976490:0:14213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a64f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400629.976519:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a64f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54cb expref: 8 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400629.976534:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a64f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54cb expref: 7 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400629.976542:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937385189900) 00010000:00010000:3.0:1786400629.976545:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400629.976547:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e400, rc 0) 00000100:00100000:3.0:1786400629.976605:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+7:13757:x1873176368885376:12345-192.168.201.23@tcp:101:mkdir.0 Request processed in 873us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400629.976613:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1786400630.164554:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392998400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400630.164639:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400630.164733:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392998656:0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.164791:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400630.164824:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400630.164830:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3318:1873176392998528:0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.164867:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400630.165279:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392998784:0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.165314:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400630.165372:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392998656 00000100:00100000:1.0:1786400630.165381:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392998656 00000100:00080000:2.0:1786400630.165432:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400630.165464:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392998784 00000100:00100000:1.0:1786400630.165469:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392998784 00000100:00100000:1.0:1786400630.165504:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786400630.165514:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392998656:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786400630.165530:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400630.165573:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392998656:12345-0@lo:400:kworker.0 Request processed in 60us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400630.165581:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786400630.165601:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786400630.165610:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1873176392998784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.165780:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1873176392998784:12345-0@lo:400:kworker.0 Request processed in 171us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400630.165788:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786400630.166452:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176392998784:0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.166501:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392998656:0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.166522:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392998528 00000100:00100000:1.0:1786400630.166526:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392998528 00000100:00100000:1.0:1786400630.166559:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1786400630.166566:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3318:x1873176392998528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.166610:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3318:x1873176392998528:12345-0@lo:400:kworker.0 Request processed in 44us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400630.166616:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1786400630.166928:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3318:1873176392998528:0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.175367:0:14852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392998400 00000100:00100000:1.0:1786400630.175385:0:14852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392998400 00000100:00100000:1.0:1786400630.175452:0:14852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400630.175462:0:14852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1873176392998400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400630.175499:0:14852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400630.176376:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400630.176395:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392998912:0@lo:400:kworker.0 00000100:00100000:0.0:1786400630.176651:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400630.176716:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392999040:0@lo:400:kworker.0 00000100:00100000:0.0:1786400630.176758:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400630.176805:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392999168:0@lo:400:kworker.0 00000100:00100000:3.0:1786400630.176830:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392998912 00000100:00100000:3.0:1786400630.176838:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392998912 00000100:00100000:0.0:1786400630.176840:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400630.176871:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392999040 00000100:00100000:0.0:1786400630.176877:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392999040 00000100:00100000:3.0:1786400630.176887:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392999168 00000100:00100000:3.0:1786400630.176892:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392999168 00000100:00100000:0.0:1786400630.176916:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786400630.176923:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786400630.176928:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392998912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400630.176937:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392999040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400630.176993:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392998912:12345-0@lo:400:kworker.0 Request processed in 69us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400630.176997:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1873176392999040:12345-0@lo:400:kworker.0 Request processed in 63us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400630.177006:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400630.177027:0:14212:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1786400630.177035:0:14212:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1786400630.177054:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400630.177227:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1873176392999040:0@lo:400:kworker.0 00000100:00100000:0.0:1786400630.177271:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392998912:0@lo:400:kworker.0 00000100:00100000:1.0:1786400630.178275:0:14852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1873176392998400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2811us (13633us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400630.178286:0:14852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400630.178562:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400630.178580:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786400630.178597:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392999168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400630.178681:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176392999168:12345-0@lo:400:kworker.0 Request processed in 87us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400630.178688:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786400630.178726:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176392999168:0@lo:400:kworker.0 00000100:00100000:3.0:1786400630.178790:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392998400:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1786400630.314772:0:7536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1786400630.314812:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 96fe1f16-deaa-49ac-af27-b01352c851d6 00000001:00100000:2.0:1786400630.314850:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1786400630.355494:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400631.379044:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400631.699614:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400631.699636:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392999296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400631.699729:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400631.699871:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392999296 00000100:00100000:0.0:1786400631.699879:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392999296 00000100:00100000:0.0:1786400631.699932:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786400631.699942:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392999296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400631.699977:0:14853:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400631.700022:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176392999296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400631.700043:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786400631.700087:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176392999296:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1786400631.769067:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 96fe1f16-deaa-49ac-af27-b01352c851d6 00000100:00100000:3.0:1786400632.203949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.204067:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368885504 00000100:00100000:0.0:1786400632.204077:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368885504 00000100:00100000:0.0:1786400632.204164:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1786400632.204175:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+7:13811:x1873176368885504:12345-192.168.201.23@tcp:41:lfs.0 00000004:00000024:0.0:1786400632.204221:0:14211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786400632.204313:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+7:13811:x1873176368885504:12345-192.168.201.23@tcp:41:lfs.0 Request processed in 141us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400632.204320:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00080000:2.0:1786400632.204880:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400632.221468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.232220:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368885632 00000100:00100000:0.0:1786400632.232238:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368885632 00000100:00100000:0.0:1786400632.232333:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:0.0:1786400632.232345:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:96fe1f16-deaa-49ac-af27-b01352c851d6+5:13811:x1873176368885632:12345-192.168.201.23@tcp:13:lfs.0 00002000:00000024:0.0:1786400632.232372:0:14853:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400632.232455:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:96fe1f16-deaa-49ac-af27-b01352c851d6+5:13811:x1873176368885632:12345-192.168.201.23@tcp:13:lfs.0 Request processed in 114us (11002us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400632.232462:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00080000:2.0:1786400632.233280:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400632.236455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.236701:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368885760 00000100:00100000:0.0:1786400632.236712:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368885760 00000100:00100000:0.0:1786400632.236827:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1786400632.236839:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:96fe1f16-deaa-49ac-af27-b01352c851d6+5:13811:x1873176368885760:12345-192.168.201.23@tcp:13:lfs.0 00000100:00080000:2.0:1786400632.236863:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1786400632.236893:0:14853:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400632.236977:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:96fe1f16-deaa-49ac-af27-b01352c851d6+5:13811:x1873176368885760:12345-192.168.201.23@tcp:13:lfs.0 Request processed in 141us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400632.237000:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00010000:00010000:2.0:1786400632.403020:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400632.621801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400632.621967:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368885888 00000100:00100000:2.0:1786400632.621977:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368885888 00000100:00100000:2.0:1786400632.622041:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 90 00000100:00100000:2.0:1786400632.622051:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+10:13844:x1873176368885888:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786400632.622069:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400632.622089:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93739102fc00/0x49554f35ff0a64ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f54d2 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.622133:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93739102fc00/0x49554f35ff0a64ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54d2 expref: 11 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.622146:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93739102fc00/0x49554f35ff0a64ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54d2 expref: 11 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.622167:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102fc00, rc 0) 00000100:00100000:2.0:1786400632.622248:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13844:x1873176368885888:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 198us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400632.622257:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 90 00000100:00100000:1.0:1786400632.628659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.628862:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368886016 00000100:00100000:0.0:1786400632.628874:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368886016 00000100:00100000:0.0:1786400632.628938:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:0.0:1786400632.628948:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739868d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13844:x1873176368886016:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786400632.629476:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739868d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13844:x1873176368886016:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 528us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400632.629486:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:0.0:1786400632.652234:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400632.652397:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368886144 00000100:00100000:1.0:1786400632.652407:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368886144 00000100:00100000:1.0:1786400632.652471:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:1.0:1786400632.652482:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13844:x1873176368886144:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:1.0:1786400632.653935:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13844:x1873176368886144:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 1445us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400632.653948:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:1.0:1786400632.686944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.687635:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368886272 00000100:00100000:0.0:1786400632.687647:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368886272 00000100:00100000:0.0:1786400632.687719:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:0.0:1786400632.687730:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13851:x1873176368886272:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400632.688148:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13851:x1873176368886272:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 419us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400632.688158:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:0.0:1786400632.748667:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400632.748773:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368886400 00000100:00100000:1.0:1786400632.748784:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368886400 00000100:00100000:1.0:1786400632.748839:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:1.0:1786400632.748849:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13851:x1873176368886400:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400632.749178:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13851:x1873176368886400:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 327us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400632.749186:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:1.0:1786400632.763939:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400632.764057:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368886528 00000100:00100000:2.0:1786400632.764067:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368886528 00000100:00100000:2.0:1786400632.764141:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:2.0:1786400632.764157:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13844:x1873176368886528:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786400632.764176:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400632.764195:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93739102ee00/0x49554f35ff0a6506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f54fc expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.764237:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93739102ee00/0x49554f35ff0a6506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54fc expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.764280:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93739102ee00/0x49554f35ff0a6506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54fc expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.764292:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102ee00, rc 0) 00000100:00100000:2.0:1786400632.764380:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13844:x1873176368886528:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 230us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400632.764388:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:3.0:1786400632.769324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.771386:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368886656 00000100:00100000:0.0:1786400632.771403:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368886656 00000100:00100000:0.0:1786400632.771487:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00100000:0.0:1786400632.771498:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13844:x1873176368886656:12345-192.168.201.23@tcp:256:mount.lustre.0 20000000:01000000:0.0:1786400632.771524:0:14206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1786400632.771550:0:14206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1786400632.771555:0:14206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1786400632.771558:0:14206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1786400632.771566:0:14206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1786400632.774465:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13844:x1873176368886656:12345-192.168.201.23@tcp:256:mount.lustre.0 Request processed in 2956us (5140us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400632.774489:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00100000:1.0:1786400632.777809:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400632.782130:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368886784 00000100:00100000:2.0:1786400632.782151:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368886784 00000100:00100000:2.0:1786400632.782240:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 97 00000100:00100000:2.0:1786400632.782251:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13844:x1873176368886784:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786400632.782269:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400632.782289:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5503 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.782321:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 13 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.782336:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 13 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400632.782346:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102f400, rc 0) 00000100:00100000:2.0:1786400632.782428:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13844:x1873176368886784:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 177us (4629us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400632.782435:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 97 00000100:00100000:3.0:1786400632.788556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400632.788879:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368886912 00000100:00100000:1.0:1786400632.788891:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368886912 00000100:00100000:1.0:1786400632.788959:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:1.0:1786400632.788971:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13844:x1873176368886912:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1786400632.790581:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13844:x1873176368886912:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 1598us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400632.790594:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:1.0:1786400632.805208:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.805338:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368887040 00000100:00100000:0.0:1786400632.805350:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368887040 00000100:00100000:0.0:1786400632.805477:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:0.0:1786400632.805499:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13844:x1873176368887040:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786400632.805776:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13844:x1873176368887040:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 288us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400632.805785:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:0.0:1786400632.814956:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400632.815081:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368887168 00000100:00100000:1.0:1786400632.815092:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368887168 00000100:00100000:1.0:1786400632.815410:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:1.0:1786400632.815422:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13853:x1873176368887168:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786400632.815702:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13853:x1873176368887168:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 282us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400632.815711:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:3.0:1786400632.822078:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.822217:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368887296 00000100:00100000:0.0:1786400632.822303:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368887296 00000100:00100000:0.0:1786400632.822368:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:0.0:1786400632.822378:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13853:x1873176368887296:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400632.823420:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13853:x1873176368887296:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 1037us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400632.823430:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:0.0:1786400632.851581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400632.851865:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368887424 00000100:00100000:2.0:1786400632.851892:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368887424 00000100:00100000:2.0:1786400632.851953:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1786400632.851964:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1873176368887424:12345-192.168.201.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1786400632.852001:0:14212:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7f319fa2-685e-40ac-bcb2-a030582224fd@192.168.201.23@tcp t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:2.0:1786400632.852041:0:14212:0:(genops.c:1406:class_connect()) connect: client 7f319fa2-685e-40ac-bcb2-a030582224fd, cookie 0x49554f35ff0a6514 00000004:00100000:2.0:1786400632.852080:0:14212:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1786400632.852478:0:14212:0:(import.c:65:import_set_state_nolock()) ffff9373bf3f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400632.852558:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2358:x1873176368887424:12345-192.168.201.23@tcp:38:mount.lustre.0 Request processed in 594us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400632.852566:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1786400632.859904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400632.859948:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400632.860023:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368887680 00000100:00100000:3.0:1786400632.860033:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368887680 00000100:00100000:3.0:1786400632.860112:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368887552 00000100:00100000:3.0:1786400632.860115:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368887552 00000100:00100000:3.0:1786400632.860137:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:3.0:1786400632.860145:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+7:13844:x1873176368887680:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786400632.860200:0:14213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786400632.860450:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+7:13844:x1873176368887680:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 305us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400632.860459:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:3.0:1786400632.860478:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:3.0:1786400632.860486:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+6:0:x1873176368887552:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786400632.860511:0:14213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786400632.860535:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+6:0:x1873176368887552:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 50us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400632.860542:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00080000:2.0:1786400632.861734:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400632.870643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400632.870783:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368887808 00000100:00100000:0.0:1786400632.870793:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368887808 00000100:00100000:0.0:1786400632.870860:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:0.0:1786400632.870872:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+6:13844:x1873176368887808:12345-192.168.201.23@tcp:40:mount.lustre.0 00000100:00100000:0.0:1786400632.874523:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+6:13844:x1873176368887808:12345-192.168.201.23@tcp:40:mount.lustre.0 Request processed in 3637us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400632.874543:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:3.0:1786400632.886475:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400632.886523:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400632.886562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400632.886683:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368887936 00000100:00100000:2.0:1786400632.886696:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368887936 00000100:00100000:2.0:1786400632.886775:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368888064 00000100:00100000:2.0:1786400632.886778:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368888064 00000100:00100000:2.0:1786400632.886799:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1786400632.886808:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873176368887936:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786400632.886848:0:14850:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7f319fa2-685e-40ac-bcb2-a030582224fd@192.168.201.23@tcp t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:2.0:1786400632.886886:0:14850:0:(genops.c:1406:class_connect()) connect: client 7f319fa2-685e-40ac-bcb2-a030582224fd, cookie 0x49554f35ff0a651b 00002000:00100000:2.0:1786400632.886897:0:14850:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7f319fa2-685e-40ac-bcb2-a030582224fd/ffff9373bf3f2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786400632.886926:0:14850:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786400632.887193:0:14850:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786400632.887235:0:14850:0:(import.c:65:import_set_state_nolock()) ffff9373bf3f7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400632.887300:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2358:x1873176368887936:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 491us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400632.887320:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1786400632.887338:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1786400632.887343:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873176368888064:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786400632.887357:0:14850:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7f319fa2-685e-40ac-bcb2-a030582224fd@192.168.201.23@tcp t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:2.0:1786400632.887372:0:14850:0:(genops.c:1406:class_connect()) connect: client 7f319fa2-685e-40ac-bcb2-a030582224fd, cookie 0x49554f35ff0a6522 00002000:00100000:2.0:1786400632.887377:0:14850:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7f319fa2-685e-40ac-bcb2-a030582224fd/ffff9373bf3f5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786400632.887383:0:14850:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786400632.887513:0:14850:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786400632.887528:0:14850:0:(import.c:65:import_set_state_nolock()) ffff9373987c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400632.887551:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2358:x1873176368888064:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 206us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400632.887557:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:1.0:1786400632.888127:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368888192 00000100:00100000:1.0:1786400632.888135:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368888192 00000100:00100000:1.0:1786400632.888182:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:1.0:1786400632.888190:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+6:13844:x1873176368888192:12345-192.168.201.23@tcp:33:mount.lustre.0 00000004:00200000:1.0:1786400632.888381:0:14215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1786400632.888515:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+6:13844:x1873176368888192:12345-192.168.201.23@tcp:33:mount.lustre.0 Request processed in 325us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400632.888529:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:3.0:1786400633.210357:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400633.210669:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368888320 00000100:00100000:1.0:1786400633.210680:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368888320 00000100:00100000:1.0:1786400633.210796:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:1.0:1786400633.210807:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+6:13873:x1873176368888320:12345-192.168.201.23@tcp:101:mkdir.0 00010000:00010000:1.0:1786400633.210829:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400633.210853:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6529 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f552d expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400633.210922:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400633.210935:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400633.210948:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400633.211182:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786400633.211187:0:15990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400633.211924:0:15990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400633.211961:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6529 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 8 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400633.211977:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 7 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400633.211999:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937385189900) 00010000:00010000:1.0:1786400633.212002:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400633.212006:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe200, rc 0) 00000100:00100000:1.0:1786400633.212136:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+7:13873:x1873176368888320:12345-192.168.201.23@tcp:101:mkdir.0 Request processed in 1329us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400633.212145:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00010000:00010000:0.0:1786400633.429403:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786400633.877939:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1786400634.453557:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786400634.864163:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f319fa2-685e-40ac-bcb2-a030582224fd 00000001:00100000:3.0:1786400634.864180:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 96fe1f16-deaa-49ac-af27-b01352c851d6 00000100:00100000:2.0:1786400635.283190:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392999808:0@lo:400:kworker.0 00000100:00100000:2.0:1786400635.283274:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400635.283353:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786400635.283360:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176392999424:0@lo:400:kworker.0 00000100:00100000:2.0:1786400635.283392:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400635.283433:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392999936:0@lo:400:kworker.0 00000100:00100000:2.0:1786400635.283455:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400635.283485:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392999424 00000100:00100000:2.0:1786400635.283493:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392999424 00000100:00100000:2.0:1786400635.283539:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786400635.283548:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3315:x1873176392999424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400635.283619:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3315:x1873176392999424:12345-0@lo:400:kworker.0 Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400635.283642:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786400635.283698:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176392999424:0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.283891:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392999680:0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.283928:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400635.283948:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786400635.283954:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392999552:0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.283976:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400635.283989:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176393000064:0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284007:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400635.284033:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392999680 00000100:00100000:3.0:1786400635.284037:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392999680 00000100:00100000:3.0:1786400635.284109:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392999552 00000100:00100000:3.0:1786400635.284114:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392999552 00000100:00100000:3.0:1786400635.284136:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400635.284144:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392999680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284182:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392999680:12345-0@lo:400:kworker.0 Request processed in 39us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400635.284199:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400635.284213:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400635.284219:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392999552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284246:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176392999552:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400635.284251:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400635.284268:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392999808 00000100:00100000:3.0:1786400635.284271:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392999808 00000100:00100000:3.0:1786400635.284289:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176392999936 00000100:00100000:3.0:1786400635.284291:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176392999936 00000100:00100000:3.0:1786400635.284301:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393000064 00000100:00100000:3.0:1786400635.284303:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393000064 00000100:00100000:3.0:1786400635.284314:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786400635.284319:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392999808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284348:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176392999808:12345-0@lo:400:kworker.0 Request processed in 29us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400635.284354:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786400635.284363:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786400635.284368:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392999936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284387:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176392999936:12345-0@lo:400:kworker.0 Request processed in 19us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400635.284392:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786400635.284399:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400635.284404:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176393000064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284422:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1873176393000064:12345-0@lo:400:kworker.0 Request processed in 18us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400635.284435:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1786400635.284450:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786400635.284455:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786400635.284457:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400635.284480:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392999552:0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284488:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1873176393000064:0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284496:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1786400635.284510:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176392999680:0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284532:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176392999936:0@lo:400:kworker.0 00000100:00100000:3.0:1786400635.284540:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176392999808:0@lo:400:kworker.0 00000100:00100000:2.0:1786400635.289597:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393000192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400635.289897:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400635.289952:0:14852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393000192 00000100:00100000:2.0:1786400635.289959:0:14852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393000192 00000100:00100000:2.0:1786400635.290006:0:14852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400635.290015:0:14852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393000192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400635.290046:0:14852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400635.290099:0:14852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393000192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400635.290107:0:14852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400635.290169:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393000192:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1786400635.387814:0:7536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f319fa2-685e-40ac-bcb2-a030582224fd 00010000:00010000:0.0:1786400635.475018:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400636.503821:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786400636.804909:0:16078:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1786400636.822965:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400636.822994:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176393000320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400636.823078:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400636.823148:0:14852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393000320 00000100:00100000:2.0:1786400636.823157:0:14852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393000320 00000100:00100000:2.0:1786400636.823200:0:14852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400636.823209:0:14852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176393000320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400636.823251:0:14852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400636.823295:0:14852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176393000320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400636.823302:0:14852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400636.823346:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176393000320:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1786400636.918775:0:6647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f319fa2-685e-40ac-bcb2-a030582224fd 00010000:00010000:0.0:1786400637.523390:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400638.240427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400638.240615:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400638.240653:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400638.240677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400638.240700:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368888704 00000100:00100000:3.0:1786400638.240708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400638.240709:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368888704 00000100:00100000:3.0:1786400638.240728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400638.240766:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400638.240826:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368888448 00000100:00100000:1.0:1786400638.240831:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368888448 00000100:00100000:1.0:1786400638.240875:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:1.0:1786400638.240885:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:2362:x1873176368888448:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400638.240961:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:2362:x1873176368888448:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 78us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400638.240971:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:3.0:1786400638.247498:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368888960 00000100:00100000:3.0:1786400638.247525:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368888960 00000100:00100000:3.0:1786400638.247596:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368888576 00000100:00100000:3.0:1786400638.247599:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368888576 00000100:00100000:3.0:1786400638.247626:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:3.0:1786400638.247636:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2362:x1873176368888960:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400638.247764:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2362:x1873176368888960:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 129us (7109us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400638.247772:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:3.0:1786400638.247792:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:3.0:1786400638.247798:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2362:x1873176368888576:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1786400638.247820:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2362:x1873176368888576:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 23us (7112us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400638.247826:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1786400638.251576:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368889216 00000100:00100000:0.0:1786400638.251596:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368889216 00000100:00100000:0.0:1786400638.251660:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368888832 00000100:00100000:0.0:1786400638.251663:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368888832 00000100:00100000:0.0:1786400638.251678:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368889088 00000100:00100000:0.0:1786400638.251681:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368889088 00000100:00100000:0.0:1786400638.251704:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:0.0:1786400638.251715:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2362:x1873176368888704:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400638.251807:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2362:x1873176368888704:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 94us (11192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400638.251815:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:0.0:1786400638.251832:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1786400638.251838:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2362:x1873176368889216:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400638.251861:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2362:x1873176368889216:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 24us (11184us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400638.251868:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1786400638.251877:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:0.0:1786400638.251883:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2362:x1873176368888832:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400638.251903:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2362:x1873176368888832:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 20us (11174us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400638.251909:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:0.0:1786400638.251927:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1786400638.251933:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2362:x1873176368889088:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400638.251956:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2362:x1873176368889088:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 23us (11189us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400638.251962:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00080000:0.0:1786400638.252072:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400638.252077:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400638.252080:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400638.547659:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400639.574782:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400640.402986:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176393000448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400640.403140:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400640.403448:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3317:1873176393000576:0@lo:400:kworker.0 00000100:00100000:2.0:1786400640.403632:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393000704:0@lo:400:kworker.0 00000100:00100000:1.0:1786400640.403772:0:14852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393000448 00000100:00100000:1.0:1786400640.403781:0:14852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393000448 00000100:00100000:1.0:1786400640.403849:0:14852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786400640.403860:0:14852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176393000448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400640.404128:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400640.405601:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400640.405651:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176393001088:0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.405689:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400640.405728:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176393000832:0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.405769:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400640.405787:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400640.405795:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937282723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176393000960:0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.405815:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786400640.405837:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400640.405851:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393000704 00000100:00100000:0.0:1786400640.405857:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393000704 00000100:00100000:0.0:1786400640.405904:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786400640.405914:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393000704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.405974:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393000704:12345-0@lo:400:kworker.0 Request processed in 52us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400640.405981:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786400640.406012:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393001088 00000100:00100000:0.0:1786400640.406016:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393001088 00002000:00000024:1.0:1786400640.406121:0:14852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400640.406159:0:14852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176393000448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2301us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400640.406167:0:14852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786400640.406625:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393000576 00000100:00100000:2.0:1786400640.406630:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393000576 00000100:00100000:2.0:1786400640.406659:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786400640.406666:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3317:x1873176393000576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400640.406710:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3317:x1873176393000576:12345-0@lo:400:kworker.0 Request processed in 45us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400640.406717:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786400640.406794:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176393000448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400640.407134:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393000832 00000100:00100000:0.0:1786400640.407138:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393000832 00000100:00100000:0.0:1786400640.407151:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393000960 00000100:00100000:0.0:1786400640.407153:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393000960 00000100:00100000:0.0:1786400640.407169:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786400640.407175:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937282721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176393001088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.407210:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937282721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1873176393001088:12345-0@lo:400:kworker.0 Request processed in 36us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400640.407216:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786400640.407227:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786400640.407233:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176393000832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.407261:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1873176393000832:12345-0@lo:400:kworker.0 Request processed in 29us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400640.407267:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786400640.407279:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786400640.407285:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176393000960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.407309:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176393000960:12345-0@lo:400:kworker.0 Request processed in 25us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400640.407314:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1786400640.407347:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400640.407351:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400640.410145:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176393000960:0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.410196:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1873176393000832:0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.410250:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393000704:0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.410296:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3317:1873176393000576:0@lo:400:kworker.0 00000100:00100000:0.0:1786400640.410309:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937282723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1873176393001088:0@lo:400:kworker.0 00010000:00010000:3.0:1786400640.597081:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786400640.803882:0:16227:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff61860070 00000020:00000080:0.0:1786400640.803898:0:16227:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1786400640.803903:0:16227:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1786400640.803909:0:16227:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff61862300 20000000:00000080:0.0:1786400640.803916:0:16227:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9372826d2000 uarg=0000000000000000 20000000:01000000:0.0:1786400640.803968:0:16227:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1786400640.803974:0:16227:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1786400640.803978:0:16227:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1786400640.806402:0:16228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1786400640.806680:0:16227:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1786400640.815081:0:16227:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1786400640.815170:0:16227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815186:0:16227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 18 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815196:0:16227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 18 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815200:0:16227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815207:0:16227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815212:0:16227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 12 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815234:0:16227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815272:0:16227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 12 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815282:0:16227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 12 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.815294:0:16227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001216:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400640.815389:0:16227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815395:0:16227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 12 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.815401:0:16227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001344:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400640.815421:0:16227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815426:0:16227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 18 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.815431:0:16227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a01c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001472:0@lo:104: 00000100:00100000:3.0:1786400640.815463:0:16227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786400640.815507:0:16227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 18 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815526:0:16227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 18 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.815532:0:16227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391175880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001600:0@lo:104: 00000100:00100000:3.0:1786400640.815548:0:16227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786400640.815567:0:16227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 18 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.815574:0:16227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 18 pid: 14203 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.815581:0:16227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001728:0@lo:104: 00000100:00100000:3.0:1786400640.815603:0:16227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400640.815779:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786400640.815792:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393001472 00000100:00100000:1.0:1786400640.815800:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393001472 00000100:00100000:1.0:1786400640.815848:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393001600 00000100:00100000:1.0:1786400640.815852:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393001600 00000100:00100000:1.0:1786400640.815864:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393001728 00000100:00100000:1.0:1786400640.815867:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393001728 00000100:00100000:1.0:1786400640.815882:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400640.816276:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+5:16227:x1873176393001472:12345-0@lo:104: 00010000:00010000:1.0:1786400640.816290:0:14194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400640.816351:0:14194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400640.816358:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+5:16227:x1873176393001472:12345-0@lo:104: Request processed in 87us (894us total) trans 0 rc 0/0 00010000:00010000:2.0:1786400640.816397:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400640.816405:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.816413:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937399762c00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400640.816417:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.816425:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400640.816433:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400640.816451:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786400640.816486:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.816493:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400640.816511:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.816519:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff937399762c00/0x49554f35ff0a63a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a63af expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.816531:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400640.816533:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400640.816534:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400640.816782:0:16227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373984d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1786400640.816805:0:16227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a01c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001472:0@lo:104: 00000100:00100000:2.0:1786400640.820358:0:16227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a03480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001216:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400640.820583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400640.820609:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400640.820662:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368889472 00000100:00100000:3.0:1786400640.820670:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368889472 00010000:00010000:3.0:1786400640.820704:0:14196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 13 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.820755:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368889344 00000100:00100000:3.0:1786400640.820758:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368889344 00010000:00010000:3.0:1786400640.820772:0:14196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 14 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400640.820772:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:2.0:1786400640.820782:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+14:2362:x1873176368889472:12345-192.168.201.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1786400640.820783:0:14196:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1786400640.820790:0:14196:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1786400640.820796:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400640.820801:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 14 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.820811:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 14 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.820813:0:16227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001344:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400640.820830:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b8f49200/0x49554f35ff0a64d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54a1 expref: 14 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.820863:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400640.820938:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:2362:x1873176368889472:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 157us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400640.820946:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:2.0:1786400640.820973:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:2.0:1786400640.820980:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:2362:x1873176368889344:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400640.820987:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400640.820992:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 12 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.821001:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 12 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.821011:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93739102f400/0x49554f35ff0a650d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5503 expref: 12 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.821020:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400640.821039:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:2362:x1873176368889344:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 60us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400640.821045:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:0.0:1786400640.821755:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3318:1873176393001856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400640.821813:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400640.822370:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393001856 00000100:00100000:2.0:1786400640.822380:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393001856 00010000:00010000:2.0:1786400640.822407:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 19 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400640.822441:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786400640.822449:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739cc63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3318:x1873176393001856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400640.822472:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400640.822477:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 19 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.822488:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 19 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.822503:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399762e00/0x49554f35ff0a63af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a63a8 expref: 19 pid: 14206 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.822515:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400640.822563:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739cc63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:3318:x1873176393001856:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400640.822570:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786400640.822763:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3318:1873176393001856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400640.824823:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786400640.825732:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786400640.825790:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+4:16227:x1873176393001600:12345-0@lo:104: 00010000:00010000:0.0:1786400640.825811:0:14194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400640.826010:0:14194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786400640.826017:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+4:16227:x1873176393001600:12345-0@lo:104: Request processed in 240us (10467us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400640.826023:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400640.826028:0:16227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391175880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001600:0@lo:104: 00000100:00100000:0.0:1786400640.826041:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786400640.826048:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:16227:x1873176393001728:12345-0@lo:104: 00010000:00010000:0.0:1786400640.826055:0:14194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400640.826108:0:14194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786400640.826114:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+3:16227:x1873176393001728:12345-0@lo:104: Request processed in 67us (10511us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400640.826120:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400640.826145:0:16227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16227:1873176393001728:0@lo:104: 00010000:00010000:3.0:1786400640.826177:0:16227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826181:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786400640.826187:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826195:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f48a00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400640.826199:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826208:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400640.826215:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400640.826221:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786400640.826259:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826268:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400640.826291:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826298:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373b8f48a00/0x49554f35ff0a6274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a627b expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.826309:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176393001984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400640.826309:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400640.826312:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826317:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b8f49e00 already unused, calling callback (ffffffffc1dc7c20) 10000000:00010000:2.0:1786400640.826320:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826326:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400640.826332:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400640.826337:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1786400640.826343:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400640.826349:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826355:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400640.826360:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826366:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9373b8f49e00/0x49554f35ff0a6227 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49554f35ff0a622e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400640.826376:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400640.826381:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176393002112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400640.826383:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400640.826385:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400640.826386:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400640.826400:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400640.826441:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400640.826492:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393001984 00000100:00100000:2.0:1786400640.826499:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393001984 00010000:00010000:2.0:1786400640.826525:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 18 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400640.826562:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393002112 00000100:00100000:2.0:1786400640.826565:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393002112 00010000:00010000:2.0:1786400640.826577:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 19 pid: 14203 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400640.826599:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786400640.826605:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3315:x1873176393001984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400640.826615:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400640.826620:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 19 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826630:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 19 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826643:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b8f48400/0x49554f35ff0a627b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a6274 expref: 19 pid: 14204 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826656:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400640.826683:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:3315:x1873176393001984:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400640.826689:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786400640.826709:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400640.826714:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:3315:x1873176393002112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400640.826720:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400640.826724:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 17 pid: 14203 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826733:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 17 pid: 14203 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826760:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937399763800/0x49554f35ff0a622e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49554f35ff0a6227 expref: 17 pid: 14203 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826770:0:14198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826778:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826791:0:14198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826799:0:14198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826805:0:14198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826811:0:14198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826816:0:14198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400640.826825:0:14198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.826833:0:14198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.827189:0:14198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400640.827199:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400640.827222:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:3315:x1873176393002112:12345-0@lo:103:ldlm_bl.0 Request processed in 508us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400640.827228:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400640.827254:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176393002112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786400640.827261:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3315:1873176393001984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400640.827440:0:16227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.827449:0:16227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400640.827455:0:16227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9373b7a1f200/0x49554f35ff0a6537 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400641.618921:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400641.896478:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400641.899048:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368889600 00000100:00100000:1.0:1786400641.899062:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368889600 00000100:00100000:3.0:1786400641.899736:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 105 00000100:00100000:3.0:1786400641.899765:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+11:13728:x1873176368889600:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400641.899783:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400641.899805:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b7a1e600/0x49554f35ff0a653e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5534 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400641.899836:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b7a1e600/0x49554f35ff0a653e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5534 expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400641.899847:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b7a1e600/0x49554f35ff0a653e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5534 expref: 12 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400641.899862:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e600, rc 0) 00000100:00100000:3.0:1786400641.899929:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13728:x1873176368889600:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 169us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400641.899935:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 105 00000100:00100000:3.0:1786400641.905513:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400641.906248:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368889728 00000100:00100000:1.0:1786400641.906261:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368889728 00000100:00100000:1.0:1786400641.906319:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 106 00000100:00100000:1.0:1786400641.906330:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13728:x1873176368889728:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400641.906611:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13728:x1873176368889728:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 280us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400641.906619:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 106 00000100:00100000:0.0:1786400641.918397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400641.918458:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368889856 00000100:00100000:1.0:1786400641.918470:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368889856 00000100:00100000:1.0:1786400641.918535:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 107 00000100:00100000:1.0:1786400641.918545:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13728:x1873176368889856:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400641.918800:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13728:x1873176368889856:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 255us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400641.918815:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 107 00000100:00100000:1.0:1786400641.930699:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400641.931811:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368889984 00000100:00100000:3.0:1786400641.931826:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368889984 00000100:00100000:3.0:1786400641.931902:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 108 00000100:00100000:3.0:1786400641.932174:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373bfe19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+12:13728:x1873176368889984:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400641.932195:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400641.932214:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373b7a1ea00/0x49554f35ff0a6545 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f553b expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400641.932244:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373b7a1ea00/0x49554f35ff0a6545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f553b expref: 13 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400641.932256:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373b7a1ea00/0x49554f35ff0a6545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f553b expref: 13 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400641.932264:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1ea00, rc 0) 00000100:00100000:3.0:1786400641.932411:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373bfe19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13728:x1873176368889984:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 499us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400641.932418:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 108 00000100:00100000:2.0:1786400641.935601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400641.935698:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368890112 00000100:00100000:0.0:1786400641.935708:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368890112 00000100:00100000:0.0:1786400641.936118:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 109 00000100:00100000:0.0:1786400641.936132:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13728:x1873176368890112:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400641.936810:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13728:x1873176368890112:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 679us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400641.936822:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 109 00000100:00100000:1.0:1786400641.940171:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400641.940198:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393002240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400641.940274:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400641.942256:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393002240 00000100:00100000:2.0:1786400641.942280:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393002240 00000100:00100000:2.0:1786400641.942337:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786400641.942356:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393002240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400641.942399:0:14853:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400641.942814:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393002240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 459us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400641.942823:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786400641.943160:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393002240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400641.945565:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400641.945710:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368890240 00000100:00100000:3.0:1786400641.945720:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368890240 00000100:00100000:3.0:1786400641.945797:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00100000:3.0:1786400641.945821:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13728:x1873176368890240:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400641.946097:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:13728:x1873176368890240:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 277us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400641.946105:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 110 10000000:01000000:0.0:1786400642.194944:0:14208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786400642.194954:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373beb8b800 from 10 10000000:01000000:0.0:1786400642.194959:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400642.195126:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bea5ee00/0x49554f35ff0a654c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400642.195141:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373bea5ee00/0x49554f35ff0a654c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400642.195154:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373bea5ee00/0x49554f35ff0a654c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400642.195184:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400642.195266:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400642.195331:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400642.195420:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393002368 00000100:00100000:1.0:1786400642.195432:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393002368 00000100:00100000:1.0:1786400642.195527:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786400642.195538:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+16:14208:x1873176393002368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400642.195550:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400642.195563:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a6553 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a654c expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400642.195586:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a6553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a654c expref: 17 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400642.195597:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebec00/0x49554f35ff0a6553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a654c expref: 17 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400642.195606:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebec00, rc 0) 00000100:00100000:1.0:1786400642.195652:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:14208:x1873176393002368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400642.195659:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786400642.195733:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400642.195766:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373bea5ee00/0x49554f35ff0a654c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6553 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400642.195775:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373bea5ee00/0x49554f35ff0a654c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6553 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400642.195839:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400642.195866:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400642.197276:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400642.197380:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393002496 00000100:00100000:3.0:1786400642.197387:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393002496 00000100:00100000:3.0:1786400642.197427:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1786400642.197435:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:14208:x1873176393002496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400642.197804:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:14208:x1873176393002496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400642.197812:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1786400642.197974:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400642.198137:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400642.198180:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400642.198203:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400642.198283:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393002624 00000100:00100000:3.0:1786400642.198287:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393002624 00000100:00100000:3.0:1786400642.198306:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1786400642.198313:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:14208:x1873176393002624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400642.198449:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:14208:x1873176393002624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400642.198457:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1786400642.199097:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786400642.201427:0:16279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1786400642.213327:0:14208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1786400642.213373:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400642.213385:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373bea5ee00/0x49554f35ff0a654c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6553 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400642.213407:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373bea5ee00/0x49554f35ff0a654c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6553 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400642.213419:0:14208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786400642.213423:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9373b8908800 from 10 10000000:01000000:2.0:1786400642.213425:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786400642.213466:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff93739102e800/0x49554f35ff0a655a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400642.213475:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff93739102e800/0x49554f35ff0a655a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400642.213487:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff93739102e800/0x49554f35ff0a655a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400642.213513:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786400642.213589:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400642.213651:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400642.213800:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393002752 00000100:00100000:2.0:1786400642.213808:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393002752 00000100:00100000:2.0:1786400642.213873:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1786400642.213883:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+17:14208:x1873176393002752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400642.213899:0:14203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400642.213913:0:14203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93739102e200/0x49554f35ff0a6561 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a655a expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400642.213951:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93739102e200/0x49554f35ff0a6561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a655a expref: 18 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400642.213975:0:14203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93739102e200/0x49554f35ff0a6561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a655a expref: 18 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400642.213984:0:14203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102e200, rc 0) 00000100:00100000:2.0:1786400642.215189:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:14208:x1873176393002752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1302us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400642.215201:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1786400642.215272:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400642.215295:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff93739102e800/0x49554f35ff0a655a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6561 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400642.215307:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff93739102e800/0x49554f35ff0a655a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a6561 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400642.215377:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400642.215408:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400642.215435:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400642.215451:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393002880 00000100:00100000:2.0:1786400642.215456:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393002880 00000100:00100000:2.0:1786400642.215487:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1786400642.215494:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:14208:x1873176393002880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400642.215735:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:14208:x1873176393002880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400642.215764:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1786400642.215793:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393002880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400642.215830:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393003008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400642.215864:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400642.215878:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400642.215889:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393003008 00000100:00100000:2.0:1786400642.215893:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393003008 00000100:00100000:2.0:1786400642.215912:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1786400642.215918:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:14208:x1873176393003008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400642.217830:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:14208:x1873176393003008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1905us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400642.217841:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786400642.226162:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393003008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786400642.228398:0:16281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1786400642.228704:0:14208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1786400642.228758:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400642.228773:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff93739102e800/0x49554f35ff0a655a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6561 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400642.228808:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff93739102e800/0x49554f35ff0a655a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a6561 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400642.228819:0:14208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786400642.228822:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff937399fd8000 from 10 10000000:01000000:3.0:1786400642.228825:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400642.228880:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1fe00/0x49554f35ff0a6568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400642.228888:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9373b7a1fe00/0x49554f35ff0a6568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400642.228899:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9373b7a1fe00/0x49554f35ff0a6568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400642.228929:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391177b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393003136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786400642.229029:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400642.229072:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390825900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400642.235536:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393003136 00000100:00100000:1.0:1786400642.235571:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393003136 00000100:00100000:1.0:1786400642.235629:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1786400642.235639:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+18:14208:x1873176393003136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400642.235657:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400642.235676:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9373bfebf200/0x49554f35ff0a656f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49554f35ff0a6568 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400642.235703:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9373bfebf200/0x49554f35ff0a656f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49554f35ff0a6568 expref: 19 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400642.235714:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9373bfebf200/0x49554f35ff0a656f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49554f35ff0a6568 expref: 19 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400642.235724:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf200, rc 0) 00000100:00100000:1.0:1786400642.235821:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:14208:x1873176393003136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (6792us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400642.235827:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1786400642.235886:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391177b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393003136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400642.235903:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9373b7a1fe00/0x49554f35ff0a6568 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a656f expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400642.235912:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9373b7a1fe00/0x49554f35ff0a6568 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49554f35ff0a656f expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400642.236048:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393003264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400642.236098:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400642.236129:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400642.236142:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393003264 00000100:00100000:1.0:1786400642.236151:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393003264 00000100:00100000:1.0:1786400642.236173:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1786400642.236180:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:14208:x1873176393003264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400642.236420:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:14208:x1873176393003264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400642.236427:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1786400642.236457:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393003264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400642.236484:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393003392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400642.236520:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400642.236532:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a98a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400642.236542:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393003392 00000100:00100000:1.0:1786400642.236545:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393003392 00000100:00100000:1.0:1786400642.236565:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1786400642.236570:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:14208:x1873176393003392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400642.236703:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:14208:x1873176393003392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400642.236709:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1786400642.236764:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:14208:1873176393003392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786400642.239720:0:16282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1786400642.240832:0:14208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1786400642.240871:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786400642.240885:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9373b7a1fe00/0x49554f35ff0a6568 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a656f expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400642.240897:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9373b7a1fe00/0x49554f35ff0a6568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49554f35ff0a656f expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400642.644174:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786400643.093817:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1786400643.376016:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400643.376056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400643.376074:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400643.376104:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368890752 00000100:00100000:2.0:1786400643.376114:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368890752 00000100:00100000:2.0:1786400643.376168:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368891008 00000100:00100000:2.0:1786400643.376171:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368891008 00000100:00100000:2.0:1786400643.376193:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1786400643.376205:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2359:x1873176368890752:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400643.376306:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2359:x1873176368890752:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 103us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400643.376314:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1786400643.376331:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1786400643.376338:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2359:x1873176368891008:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400643.376363:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2359:x1873176368891008:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400643.376506:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1786400643.376621:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400643.376689:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400643.376792:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400643.376814:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400643.376825:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368890624 00000100:00100000:2.0:1786400643.376828:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368890624 00000100:00100000:2.0:1786400643.376846:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368891136 00000100:00100000:2.0:1786400643.376849:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368891136 00000100:00100000:2.0:1786400643.376862:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1786400643.376868:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2359:x1873176368890624:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400643.376898:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2359:x1873176368890624:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400643.376904:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1786400643.376927:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1786400643.376934:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2359:x1873176368891136:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400643.376970:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2359:x1873176368891136:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 37us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400643.376977:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1786400643.377082:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368890496 00000100:00100000:0.0:1786400643.377087:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368890496 00000100:00100000:0.0:1786400643.377126:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368890880 00000100:00100000:0.0:1786400643.377129:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368890880 00000100:00100000:0.0:1786400643.377154:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1786400643.377161:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2359:x1873176368890496:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400643.377196:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2359:x1873176368890496:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 36us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400643.377203:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1786400643.377218:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:0.0:1786400643.377224:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2359:x1873176368890880:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400643.377260:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2359:x1873176368890880:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400643.377266:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00080000:0.0:1786400643.377284:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400643.377288:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786400643.377290:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400643.377414:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368890368 00000100:00100000:0.0:1786400643.377419:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368890368 00000100:00100000:0.0:1786400643.377447:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:0.0:1786400643.377454:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:2359:x1873176368890368:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400643.377482:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:2359:x1873176368890368:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400643.377489:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 120 00010000:00010000:2.0:1786400643.666962:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400644.693401:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400645.371153:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400645.371908:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368891264 00000100:00100000:3.0:1786400645.371921:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368891264 00000100:00100000:3.0:1786400645.372016:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:3.0:1786400645.372026:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+6:14385:x1873176368891264:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400645.372047:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400645.372067:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a6576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5542 expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.372156:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.372171:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.372183:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.372198:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.372205:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.372212:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786400645.372918:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786400645.374903:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a658b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.374925:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a658b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.374937:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a658b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400645.375141:0:14211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1786400645.375146:0:14211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400645.375243:0:14211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a658b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375269:0:14211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375275:0:14211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375281:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375286:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400645.375291:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375298:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375312:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937385189900) 00010000:00010000:3.0:1786400645.375315:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400645.375319:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375324:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a657d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375337:0:14211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.375343:0:14211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.376693:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.376717:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400645.376721:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.376730:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.376757:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff937385189000) 00010000:00010000:3.0:1786400645.376761:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400645.377578:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.377591:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a6584 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.377653:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a6576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5542 expref: 8 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.377667:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1fc00/0x49554f35ff0a658b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5542 expref: 7 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.377675:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff937385189300) 00010000:00010000:3.0:1786400645.377678:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400645.377680:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1fc00, rc 0) 00000100:00100000:2.0:1786400645.378240:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+7:14385:x1873176368891264:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 6212us (7094us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400645.378250:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:2.0:1786400645.393390:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.393627:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368891520 00000100:00100000:0.0:1786400645.393638:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368891520 00000100:00100000:0.0:1786400645.393701:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:0.0:1786400645.393711:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+7:14385:x1873176368891520:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400645.393732:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400645.393775:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e400/0x49554f35ff0a6592 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5549 expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.393866:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.393890:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.393917:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.394380:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.394391:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.394400:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.395264:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f600/0x49554f35ff0a65a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.395278:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f600/0x49554f35ff0a65a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.395288:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f600/0x49554f35ff0a65a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400645.395299:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1786400645.396705:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.396719:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.396726:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.396732:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5fe00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400645.396782:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.396789:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397309:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff937385189300) 00010000:00010000:0.0:1786400645.397314:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400645.397320:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397328:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6599 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397566:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397575:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397581:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397586:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5e000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400645.397589:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397596:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397606:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93739128d200) 00010000:00010000:0.0:1786400645.397608:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400645.397622:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.397628:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e000/0x49554f35ff0a65a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.398567:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e400/0x49554f35ff0a6592 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5549 expref: 10 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.398589:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f600/0x49554f35ff0a65a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5549 expref: 9 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.398598:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93739128d300) 00010000:00010000:0.0:1786400645.398600:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400645.398603:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5f600, rc 0) 00000100:00100000:0.0:1786400645.398791:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14385:x1873176368891520:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 5079us (5411us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1786400645.398801:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:0.0:1786400645.413959:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400645.414367:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368891648 00000100:00100000:1.0:1786400645.414377:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368891648 00000100:00100000:1.0:1786400645.414452:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:1.0:1786400645.414462:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14385:x1873176368891648:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1786400645.414588:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14385:x1873176368891648:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 126us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400645.414595:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1786400645.445495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400645.445830:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368891776 00000100:00100000:3.0:1786400645.445852:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368891776 00000100:00100000:3.0:1786400645.445963:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:3.0:1786400645.445989:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14391:x1873176368891776:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400645.446057:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400645.446088:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a65b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5550 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.446181:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.446205:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.446217:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.446239:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.446245:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.446259:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449043:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449062:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449070:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449075:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400645.449080:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449087:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449105:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937385189900) 00010000:00010000:2.0:1786400645.449119:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400645.449124:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449130:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f400/0x49554f35ff0a65bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449157:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449165:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449171:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449191:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400645.449194:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449200:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449207:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff937385189000) 00010000:00010000:2.0:1786400645.449210:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400645.449213:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449219:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f200/0x49554f35ff0a65c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449265:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a65b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5550 expref: 10 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449275:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937385189900) 00010000:00010000:2.0:1786400645.449278:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400645.449282:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ee00/0x49554f35ff0a65b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5550 expref: 10 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.449291:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1ee00, rc 0) 00000100:00100000:2.0:1786400645.452476:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14391:x1873176368891776:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 3397us (3899us total) trans 0 rc 301/301 00000100:00100000:2.0:1786400645.452497:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:3.0:1786400645.457834:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400645.458206:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368891904 00000100:00100000:1.0:1786400645.458216:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368891904 00000100:00100000:1.0:1786400645.458324:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1786400645.458336:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14391:x1873176368891904:12345-192.168.201.23@tcp:700:lfs.0 00000100:00100000:1.0:1786400645.458442:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14391:x1873176368891904:12345-192.168.201.23@tcp:700:lfs.0 Request processed in 108us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400645.458450:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:0.0:1786400645.464123:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400645.464371:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368892160 00000100:00100000:2.0:1786400645.464395:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368892160 00000100:00100000:2.0:1786400645.464454:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:2.0:1786400645.464465:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14391:x1873176368892160:12345-192.168.201.23@tcp:36:lfs.0 00010000:00010000:2.0:1786400645.464530:0:14212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400645.464556:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e400/0x49554f35ff0a64f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f54cb expref: 9 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.464576:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937385189900) 00010000:00010000:2.0:1786400645.464581:0:14212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400645.465048:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.465065:0:14212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 5 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.465074:0:14212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.465109:0:14212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 5 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.465136:0:14212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 5 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400645.465151:0:14212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14212:1873176393003520:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400645.465318:0:14212:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b7871180 going to sleep for 11 seconds 00000100:00100000:1.0:1786400645.469020:0:14212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14212:1873176393003520:192.168.201.23@tcp:104: 00010000:00010000:1.0:1786400645.469052:0:14212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400645.469962:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400645.470395:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368892288 00000100:00100000:2.0:1786400645.470404:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368892288 00010000:00010000:2.0:1786400645.470458:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 6 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400645.470498:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:2.0:1786400645.470516:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2362:x1873176368892288:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400645.470531:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400645.470537:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 6 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.470549:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 6 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.470571:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6530 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f552d expref: 6 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.470587:0:14198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937385189900) 00010000:00010000:2.0:1786400645.470605:0:14198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.470613:0:14198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.470620:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.470655:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400645.470708:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2362:x1873176368892288:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 202us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400645.470717:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00010000:00010000:1.0:1786400645.470867:0:14212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.470885:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.470911:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.470921:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.470930:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786400645.471931:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1786400645.474586:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1786400645.474606:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.474616:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.474635:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.474642:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebea00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400645.474646:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.474654:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.474670:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937385189900) 00010000:00010000:1.0:1786400645.474673:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400645.474677:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.474683:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65ca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400645.474708:0:14212:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000afcc4a3f reply state 00000000b207ba64 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400645.474717:0:14212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400645.474833:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+10:14391:x1873176368892160:12345-192.168.201.23@tcp:36:lfs.0 Request processed in 10367us (10716us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1786400645.474914:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00010000:00010000:1.0:1786400645.484615:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.484633:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.484657:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.484663:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfc00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400645.484668:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.484675:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.484692:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9373850bf900) 00010000:00010000:1.0:1786400645.484695:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400645.484699:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.484705:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400645.523417:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176393003776:0@lo:400:kworker.0 00000100:00100000:2.0:1786400645.523515:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400645.523582:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393003776 00000100:00100000:2.0:1786400645.523592:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393003776 00000100:00100000:2.0:1786400645.523650:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786400645.523661:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176393003776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400645.523718:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1873176393003776:12345-0@lo:400:kworker.0 Request processed in 59us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400645.523726:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786400645.523792:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1873176393003776:0@lo:400:kworker.0 00000100:00100000:2.0:1786400645.523835:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176393003904:0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.524142:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b6ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3318:1873176393003648:0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.524181:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400645.524223:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400645.524230:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393004032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400645.524255:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400645.524284:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393004032 00000100:00100000:3.0:1786400645.524288:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393004032 00000100:00100000:3.0:1786400645.524339:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400645.524345:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393004032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400645.524377:0:14853:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400645.524416:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393004032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400645.524422:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400645.524459:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393004032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400645.524502:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176393004160:0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.524529:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400645.524588:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176393004288:0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.524611:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400645.524629:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400645.524634:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176393004416:0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.524653:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400645.524682:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393004160 00000100:00100000:3.0:1786400645.524686:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393004160 00000100:00100000:3.0:1786400645.524709:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393004288 00000100:00100000:3.0:1786400645.524712:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393004288 00000100:00100000:3.0:1786400645.524726:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393004416 00000100:00100000:3.0:1786400645.524728:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393004416 00000100:00100000:3.0:1786400645.524767:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400645.524775:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176393004160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.524810:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1873176393004160:12345-0@lo:400:kworker.0 Request processed in 35us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400645.524817:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400645.524830:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786400645.524837:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176393004288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400645.524982:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393003648 00000100:00100000:1.0:1786400645.524987:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393003648 00000100:00100000:1.0:1786400645.525018:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1786400645.525026:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3318:x1873176393003648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400645.525065:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3318:x1873176393003648:12345-0@lo:400:kworker.0 Request processed in 41us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400645.525073:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1786400645.525106:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786400645.525115:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176393004416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400645.525150:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1873176393004416:12345-0@lo:400:kworker.0 Request processed in 37us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400645.525169:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786400645.525218:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1873176393004160:0@lo:400:kworker.0 00000100:00100000:1.0:1786400645.525229:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3318:1873176393003648:0@lo:400:kworker.0 00000100:00100000:1.0:1786400645.525264:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1873176393004416:0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.528666:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1873176393004288:12345-0@lo:400:kworker.0 Request processed in 3824us (4048us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400645.528677:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786400645.528769:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1873176393004288:0@lo:400:kworker.0 00000100:00080000:3.0:1786400645.528825:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786400645.528833:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400645.528835:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400645.528986:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400645.530177:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393003904 00000100:00100000:3.0:1786400645.530188:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393003904 00000100:00100000:3.0:1786400645.530469:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400645.530482:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176393003904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.530615:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176393003904:12345-0@lo:400:kworker.0 Request processed in 136us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400645.530622:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786400645.542067:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b6ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176393003904:0@lo:400:kworker.0 00000100:00100000:3.0:1786400645.576336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400645.576555:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368892416 00000100:00100000:1.0:1786400645.576566:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368892416 00000100:00100000:1.0:1786400645.576624:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:1.0:1786400645.576635:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+9:14399:x1873176368892416:12345-192.168.201.23@tcp:101:lctl.0 00010000:00010000:1.0:1786400645.576663:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400645.576687:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5557 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.576794:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.576808:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.576819:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400645.576917:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786400645.576921:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400645.576976:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.577022:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfc00/0x49554f35ff0a65d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5557 expref: 11 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.577041:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebea00/0x49554f35ff0a65df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5557 expref: 10 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.577050:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:1.0:1786400645.577052:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400645.577056:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebea00, rc 0) 00000100:00100000:1.0:1786400645.577123:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+10:14399:x1873176368892416:12345-192.168.201.23@tcp:101:lctl.0 Request processed in 490us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400645.577130:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:0.0:1786400645.606336:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400645.606680:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368892544 00000100:00100000:3.0:1786400645.606694:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368892544 00000100:00100000:3.0:1786400645.606802:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:3.0:1786400645.606813:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+5:14400:x1873176368892544:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1786400645.606835:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400645.606871:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a65e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f555e expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.607193:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a65ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.607209:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a65ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.607238:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a65ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400645.607301:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786400645.607305:0:15990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400645.607333:0:15990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a65ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.607360:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a65e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f555e expref: 7 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.607380:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1e800/0x49554f35ff0a65ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f555e expref: 6 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.607389:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:3.0:1786400645.607392:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400645.607396:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1e800, rc 0) 00000100:00100000:3.0:1786400645.607508:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+6:14400:x1873176368892544:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 696us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400645.607516:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:2.0:1786400645.612507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400645.612596:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368892672 00000100:00100000:1.0:1786400645.612606:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368892672 00000100:00100000:1.0:1786400645.612701:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:1.0:1786400645.612712:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+6:14400:x1873176368892672:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400645.612735:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400645.612774:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a65f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5565 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.612854:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.612867:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.612887:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.612916:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.612923:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613154:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613301:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6609 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613311:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613318:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400645.613361:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1786400645.613366:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400645.613398:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613412:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613419:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613426:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613443:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400645.613447:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613455:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613468:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:1.0:1786400645.613471:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400645.613476:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613481:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a65fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613497:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613503:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613510:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613515:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebfa00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400645.613518:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613524:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613543:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9373850bf600) 00010000:00010000:1.0:1786400645.613545:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400645.613548:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613554:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6602 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613588:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a65f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5565 expref: 8 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613603:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6609 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5565 expref: 7 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.613610:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9373850bfc00) 00010000:00010000:1.0:1786400645.613612:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400645.613614:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf400, rc 0) 00000100:00100000:1.0:1786400645.613691:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+7:14400:x1873176368892672:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 979us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400645.613699:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:2.0:1786400645.617147:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.617227:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368892928 00000100:00100000:0.0:1786400645.617237:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368892928 00000100:00100000:0.0:1786400645.617298:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:0.0:1786400645.617309:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+7:14400:x1873176368892928:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400645.617330:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400645.617352:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f556c expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400645.617618:0:14211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786400645.617783:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6610 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f556c expref: 9 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.617798:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:0.0:1786400645.617801:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400645.617807:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f556c expref: 9 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.617821:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5fe00, rc 0) 00000100:00100000:0.0:1786400645.618218:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+8:14400:x1873176368892928:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 909us (1079us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1786400645.618227:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:0.0:1786400645.623559:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400645.623662:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368893184 00000100:00100000:3.0:1786400645.623672:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368893184 00000100:00100000:2.0:1786400645.624181:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:2.0:1786400645.624207:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+8:14400:x1873176368893184:12345-192.168.201.23@tcp:36:lfs.0 00010000:00010000:2.0:1786400645.624263:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400645.624289:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6609 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5565 expref: 8 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.624308:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9373850bfc00) 00010000:00010000:2.0:1786400645.624319:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400645.624346:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.624359:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400645.624368:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400645.624633:0:14213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0a10f47 reply state 00000000c283a356 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400645.624644:0:14213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786400645.624658:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1786400645.624781:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f319fa2-685e-40ac-bcb2-a030582224fd+9:14400:x1873176368893184:12345-192.168.201.23@tcp:36:lfs.0 Request processed in 576us (1230us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1786400645.624789:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00010000:00010000:1.0:1786400645.626632:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.626649:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.626657:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.626683:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102ea00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400645.626690:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.626699:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.626716:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9373a10f4e00) 00010000:00010000:1.0:1786400645.626719:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1786400645.626725:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.626731:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a661e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400645.628701:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400645.629206:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368893440 00000100:00100000:2.0:1786400645.629216:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368893440 00000100:00100000:2.0:1786400645.629274:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:2.0:1786400645.629284:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+8:14400:x1873176368893440:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400645.629593:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+9:14400:x1873176368893440:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 308us (902us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1786400645.629616:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:2.0:1786400645.633510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.633606:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368893696 00000100:00100000:0.0:1786400645.633619:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368893696 00000100:00100000:0.0:1786400645.633686:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:0.0:1786400645.633697:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+9:14400:x1873176368893696:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400645.633723:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400645.634083:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5573 expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634163:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634200:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634213:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634229:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634236:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634242:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400645.634463:0:14211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786400645.634571:0:14211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634579:0:14211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634587:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634593:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400645.634597:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634604:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634629:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:0.0:1786400645.634632:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400645.634637:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634643:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a662c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634658:0:14211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634664:0:14211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634670:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634675:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5e800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400645.634678:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634684:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634692:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93739128d200) 00010000:00010000:0.0:1786400645.634694:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400645.634697:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.634703:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6633 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.635084:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6625 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5573 expref: 11 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.635095:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:0.0:1786400645.635098:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400645.635101:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5573 expref: 11 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.635111:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5fe00, rc 0) 00000100:00100000:0.0:1786400645.635216:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+10:14400:x1873176368893696:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1520us (1716us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1786400645.635224:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:1.0:1786400645.638897:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.639116:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368893824 00000100:00100000:0.0:1786400645.639127:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368893824 00000100:00100000:0.0:1786400645.639178:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:0.0:1786400645.639188:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+10:14400:x1873176368893824:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400645.639211:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400645.639233:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a6641 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f557a expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.639317:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.639330:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.639341:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400645.639415:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1786400645.639419:0:15990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400645.639444:0:15990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.639473:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a6641 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 12 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.639492:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 11 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.639500:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:0.0:1786400645.639503:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400645.639506:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5f200, rc 0) 00000100:00100000:0.0:1786400645.639576:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+11:14400:x1873176368893824:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 390us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400645.639584:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:2.0:1786400645.644307:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.644624:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368893952 00000100:00100000:0.0:1786400645.644636:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368893952 00000100:00100000:0.0:1786400645.644702:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:0.0:1786400645.644714:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+11:14400:x1873176368893952:12345-192.168.201.23@tcp:37:lfs.0 00000100:00100000:0.0:1786400645.656808:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+11:14400:x1873176368893952:12345-192.168.201.23@tcp:37:lfs.0 Request processed in 12083us (12498us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400645.656823:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:1.0:1786400645.663798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400645.663971:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368894208 00000100:00100000:3.0:1786400645.663984:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368894208 00000100:00100000:3.0:1786400645.664035:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:3.0:1786400645.664044:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385fc6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+11:14400:x1873176368894208:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1786400645.664365:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385fc6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+12:14400:x1873176368894208:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 320us (576us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1786400645.664398:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00010000:00010000:2.0:1786400645.715452:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400645.717568:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400645.717675:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368894336 00000100:00100000:1.0:1786400645.717687:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368894336 00000100:00100000:1.0:1786400645.717793:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:1.0:1786400645.717803:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+10:14406:x1873176368894336:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1786400645.717828:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400645.717861:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a664f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5581 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718176:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718192:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718215:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718229:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718235:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718242:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718363:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6664 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718372:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718380:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400645.718412:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1786400645.718417:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400645.718477:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718489:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718496:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718512:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718518:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400645.718522:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718530:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718544:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:1.0:1786400645.718547:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400645.718552:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718558:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718571:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718577:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718583:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718588:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400645.718590:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718606:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718615:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9373850bf600) 00010000:00010000:1.0:1786400645.718617:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400645.718620:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718626:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a665d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718661:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a664f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5581 expref: 12 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718673:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebfa00/0x49554f35ff0a6664 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5581 expref: 11 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.718680:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:1.0:1786400645.718682:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786400645.718684:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebfa00, rc 0) 00000100:00100000:1.0:1786400645.719646:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+11:14406:x1873176368894336:12345-192.168.201.23@tcp:101:bash.0 Request processed in 1838us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400645.719658:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:2.0:1786400645.723348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.723594:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368894592 00000100:00100000:0.0:1786400645.723605:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368894592 00000100:00100000:0.0:1786400645.723692:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:0.0:1786400645.723703:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b6ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+11:14406:x1873176368894592:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400645.723724:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400645.723792:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a666b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5588 expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.723966:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.723983:0:15990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 11 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.723992:0:15990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.724026:0:15990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 11 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.724039:0:15990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 11 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400645.724065:0:15990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7769500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15990:1873176393004544:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400645.724164:0:15990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400645.728024:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400645.728221:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368894720 00000100:00100000:1.0:1786400645.728231:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368894720 00010000:00010000:1.0:1786400645.728271:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 12 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400645.728341:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:1.0:1786400645.728351:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+12:2361:x1873176368894720:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400645.728367:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400645.728385:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 12 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.728400:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 12 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.728422:0:14197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:1.0:1786400645.728427:0:14197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.728438:0:14197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.728446:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.728464:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400645.728518:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f319fa2-685e-40ac-bcb2-a030582224fd+12:2361:x1873176368894720:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 169us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400645.728525:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00010000:00010000:0.0:1786400645.728721:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6648 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f557a expref: 11 pid: 15990 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400645.728795:0:15990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7769500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15990:1873176393004544:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400645.728820:0:15990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.728837:0:15990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.728856:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.728889:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.728899:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.728908:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730135:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730150:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730160:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400645.730172:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1786400645.730203:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730210:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730217:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730232:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5fe00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400645.730236:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730245:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730257:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:0.0:1786400645.730260:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400645.730265:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730272:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6672 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400645.730286:0:15990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056b1b60b reply state 00000000203469c9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400645.730295:0:15990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786400645.730333:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a666b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 14 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730347:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 13 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.730355:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400645.730357:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1786400645.730360:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5e200, rc 0) 00000100:00100000:0.0:1786400645.730415:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b6ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+14:14406:x1873176368894592:12345-192.168.201.23@tcp:101:bash.0 Request processed in 6714us (7077us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1786400645.730430:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00010000:00010000:1.0:1786400645.733359:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.733390:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.733416:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.733422:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5e800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400645.733427:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.733435:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.733452:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93739128d200) 00010000:00010000:1.0:1786400645.733456:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400645.733460:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400645.733466:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e800/0x49554f35ff0a6679 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400645.747920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.748252:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368894848 00000100:00100000:0.0:1786400645.748265:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368894848 00000100:00100000:0.0:1786400645.748338:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:0.0:1786400645.748350:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+13:14406:x1873176368894848:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400645.748388:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400645.748409:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a668e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f558f expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.748477:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6695 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.748490:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.748502:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400645.748539:0:14211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1786400645.748542:0:14211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400645.748558:0:14211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.748568:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.748593:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a668e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f558f expref: 15 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.748610:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6695 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f558f expref: 14 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.748633:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400645.748636:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400645.748640:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5fe00, rc 0) 00000100:00100000:0.0:1786400645.748704:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+14:14406:x1873176368894848:12345-192.168.201.23@tcp:101:bash.0 Request processed in 357us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400645.748712:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:3.0:1786400645.752058:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400645.752217:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368895104 00000100:00100000:1.0:1786400645.752230:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368895104 00000100:00100000:1.0:1786400645.752291:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:1.0:1786400645.752303:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+14:14406:x1873176368895104:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:1.0:1786400645.752699:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+15:14406:x1873176368895104:12345-192.168.201.23@tcp:35:bash.0 Request processed in 398us (662us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1786400645.752708:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:2.0:1786400645.849301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.849419:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368895360 00000100:00100000:0.0:1786400645.849431:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368895360 00000100:00100000:0.0:1786400645.849504:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:0.0:1786400645.849516:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93728239e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+15:14416:x1873176368895360:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400645.849546:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400645.849572:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a669c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5596 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400645.849710:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786400645.849902:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a669c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5596 expref: 17 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.849917:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:0.0:1786400645.849920:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400645.850122:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a669c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5596 expref: 17 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.850140:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5f400, rc 0) 00000100:00100000:0.0:1786400645.850315:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93728239e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+16:14416:x1873176368895360:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 801us (1025us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1786400645.850339:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:2.0:1786400645.858455:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400645.861171:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368895616 00000100:00100000:1.0:1786400645.861190:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368895616 00000100:00100000:1.0:1786400645.861307:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:1.0:1786400645.861335:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+16:14416:x1873176368895616:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:1.0:1786400645.861651:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+17:14416:x1873176368895616:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 318us (3816us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1786400645.861660:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:2.0:1786400645.905328:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.905438:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368895872 00000100:00100000:0.0:1786400645.905449:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368895872 00000100:00100000:0.0:1786400645.905515:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:0.0:1786400645.905525:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+17:14419:x1873176368895872:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1786400645.905551:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400645.905573:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a66aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f559d expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.905679:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.905694:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.905706:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400645.905718:0:14211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1786400645.905911:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a66aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f559d expref: 20 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.905940:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f559d expref: 19 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.905949:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400645.905952:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400645.905955:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5f200, rc 0) 00000100:00100000:0.0:1786400645.906021:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+19:14419:x1873176368895872:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 498us (704us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1786400645.906029:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:2.0:1786400645.911423:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400645.911468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400645.911509:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368896000 00000100:00100000:3.0:1786400645.911519:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368896000 00000100:00100000:3.0:1786400645.911586:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:3.0:1786400645.911595:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+19:14419:x1873176368896000:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:3.0:1786400645.911662:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911679:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911690:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911715:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911721:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911727:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911733:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400645.911764:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911771:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911799:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:3.0:1786400645.911802:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400645.911807:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400645.911813:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400645.911938:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+19:14419:x1873176368896000:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 335us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400645.911947:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:0.0:1786400645.912233:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368896128 00000100:00100000:0.0:1786400645.912238:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368896128 00000100:00100000:0.0:1786400645.912275:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:0.0:1786400645.912283:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+19:2362:x1873176368896128:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400645.912293:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400645.912311:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f559d expref: 19 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400645.912322:0:14198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400645.912325:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400645.912346:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+18:2362:x1873176368896128:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 64us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400645.912353:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:2.0:1786400645.916098:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400645.924607:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368896384 00000100:00100000:0.0:1786400645.924624:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368896384 00000100:00100000:0.0:1786400645.924701:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1786400645.924712:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+18:14419:x1873176368896384:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1786400645.925000:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+19:14419:x1873176368896384:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 289us (8987us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1786400645.925008:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000040:00080000:3.0:1786400646.163551:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1786400646.345672:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400646.345799:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368896640 00000100:00100000:0.0:1786400646.345810:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368896640 00000100:00100000:0.0:1786400646.345914:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1786400646.345935:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+19:14450:x1873176368896640:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:0.0:1786400646.345970:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400646.345990:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55a4 expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.346082:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a66cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.346096:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a66cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.346110:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a66cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400646.346122:0:14211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1786400646.346265:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55a4 expref: 22 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.346285:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a66cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55a4 expref: 21 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.346294:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400646.346297:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400646.346300:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5f400, rc 0) 00000100:00100000:0.0:1786400646.346363:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+21:14450:x1873176368896640:12345-192.168.201.23@tcp:101:cat.0 Request processed in 430us (705us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1786400646.347116:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:2.0:1786400646.350447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400646.350773:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400646.350876:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368897024 00000100:00100000:0.0:1786400646.350886:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368897024 00000100:00100000:0.0:1786400646.350951:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:0.0:1786400646.350970:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+21:14450:x1873176368897024:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:0.0:1786400646.351282:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+22:14450:x1873176368897024:12345-192.168.201.23@tcp:35:cat.0 Request processed in 314us (508us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1786400646.351290:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1786400646.355850:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368896768 00000100:00100000:3.0:1786400646.355872:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368896768 00000100:00100000:3.0:1786400646.355964:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:3.0:1786400646.355974:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+22:2362:x1873176368896768:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400646.355990:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400646.356015:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f400/0x49554f35ff0a66cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55a4 expref: 22 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400646.356034:0:14197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:3.0:1786400646.356039:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400646.356096:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+21:2362:x1873176368896768:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 124us (5660us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400646.356104:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:2.0:1786400646.465505:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400646.465602:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368897280 00000100:00100000:3.0:1786400646.465614:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368897280 00000100:00100000:3.0:1786400646.465693:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:3.0:1786400646.465704:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+21:14456:x1873176368897280:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:3.0:1786400646.465731:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400646.465796:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66db lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55ab expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400646.465944:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a66e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400646.465960:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a66e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400646.465973:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a66e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400646.465985:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1786400646.466154:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1f800/0x49554f35ff0a66db lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ab expref: 24 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400646.466174:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a66e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ab expref: 23 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400646.466183:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:3.0:1786400646.466186:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400646.466189:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1ec00, rc 0) 00000100:00100000:3.0:1786400646.466255:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+23:14456:x1873176368897280:12345-192.168.201.23@tcp:101:dd.0 Request processed in 552us (760us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1786400646.466263:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:2.0:1786400646.471631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400646.471686:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400646.471793:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368897408 00000100:00100000:0.0:1786400646.471804:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368897408 00000100:00100000:0.0:1786400646.471891:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:0.0:1786400646.471902:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739cc61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+23:2361:x1873176368897408:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400646.471931:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400646.471960:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373b7a1ec00/0x49554f35ff0a66e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ab expref: 23 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.471982:0:14198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400646.471988:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400646.472047:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739cc61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+22:2361:x1873176368897408:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 147us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400646.472056:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1786400646.472726:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368897664 00000100:00100000:1.0:1786400646.472732:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368897664 00000100:00100000:1.0:1786400646.472799:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:1.0:1786400646.472807:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+22:14456:x1873176368897664:12345-192.168.201.23@tcp:36:dd.0 00010000:00010000:1.0:1786400646.472877:0:14212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400646.472893:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fe00/0x49554f35ff0a6695 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f558f expref: 22 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.472905:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:1.0:1786400646.472909:0:14212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400646.473131:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.473146:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.473156:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400646.473205:0:14212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1786400646.473244:0:14212:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002130039a reply state 00000000add234e5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400646.473254:0:14212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400646.473341:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+24:14456:x1873176368897664:12345-192.168.201.23@tcp:36:dd.0 Request processed in 533us (1718us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1786400646.473361:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000020:00080000:1.0:1786400646.473365:0:14212:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400646.481473:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.481491:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.481499:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.481506:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400646.481512:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.481519:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.481537:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:1.0:1786400646.481540:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400646.481544:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.481550:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a66f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400646.642468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400646.642628:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368897920 00000100:00100000:0.0:1786400646.642639:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368897920 00000100:00100000:0.0:1786400646.642698:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1786400646.642708:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+23:14456:x1873176368897920:12345-192.168.201.23@tcp:35:dd.0 00000100:00100000:0.0:1786400646.643028:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+24:14456:x1873176368897920:12345-192.168.201.23@tcp:35:dd.0 Request processed in 320us (569us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1786400646.643036:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00010000:00010000:3.0:1786400646.739057:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400646.828895:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400646.828992:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368898048 00000100:00100000:0.0:1786400646.829017:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368898048 00000100:00100000:0.0:1786400646.829189:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:0.0:1786400646.829199:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+24:14469:x1873176368898048:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:0.0:1786400646.829224:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400646.829244:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55b2 expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829323:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829337:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829349:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829362:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829388:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829395:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829495:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fa00/0x49554f35ff0a670c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829503:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fa00/0x49554f35ff0a670c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829509:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fa00/0x49554f35ff0a670c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400646.829550:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1786400646.829553:0:15990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400646.829585:0:15990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fa00/0x49554f35ff0a670c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829595:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fa00/0x49554f35ff0a670c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829603:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829609:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829615:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829620:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5fc00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400646.829623:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829631:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829642:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:0.0:1786400646.829645:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400646.829649:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829655:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fc00/0x49554f35ff0a66fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829680:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829686:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829691:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829696:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5ec00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400646.829699:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829705:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829713:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93739128d700) 00010000:00010000:0.0:1786400646.829715:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400646.829718:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.829722:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6705 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.830112:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a66f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b2 expref: 26 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.830130:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fa00/0x49554f35ff0a670c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b2 expref: 25 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400646.830148:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400646.830149:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400646.830151:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5fa00, rc 0) 00000100:00100000:0.0:1786400646.830222:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+25:14469:x1873176368898048:12345-192.168.201.23@tcp:101:stat.0 Request processed in 1024us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400646.830230:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:3.0:1786400646.940655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400646.940773:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368898304 00000100:00100000:1.0:1786400646.940782:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368898304 00000100:00100000:1.0:1786400646.940834:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:1.0:1786400646.940843:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+25:14476:x1873176368898304:12345-192.168.201.23@tcp:36:truncate.0 00010000:00010000:1.0:1786400646.940937:0:14212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400646.940966:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5fa00/0x49554f35ff0a670c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b2 expref: 25 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.940987:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:1.0:1786400646.940991:0:14212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400646.941211:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.941221:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.941229:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400646.941275:0:14212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1786400646.941294:0:14212:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be4e6a2a reply state 00000000934d95e1 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400646.941301:0:14212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400646.941392:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+27:14476:x1873176368898304:12345-192.168.201.23@tcp:36:truncate.0 Request processed in 551us (746us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1786400646.941400:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00000020:00080000:1.0:1786400646.941405:0:14212:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400646.943509:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.943529:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.943536:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.943559:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400646.943564:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.943573:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.943589:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:1.0:1786400646.943592:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400646.943598:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400646.943604:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6713 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400647.061606:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176393004672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400647.061679:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400647.061809:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393004672 00000100:00100000:2.0:1786400647.061818:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393004672 00000100:00080000:3.0:1786400647.061879:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400647.061893:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400647.061903:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176393004672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400647.061936:0:14853:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400647.061991:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176393004672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400647.062014:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786400647.062045:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176393004672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400647.129887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400647.130647:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368898432 00000100:00100000:1.0:1786400647.130659:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368898432 00000100:00100000:1.0:1786400647.130732:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:1.0:1786400647.130780:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+26:14490:x1873176368898432:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:1.0:1786400647.130804:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400647.130825:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a671a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55b9 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.130916:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.130932:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.130952:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.130966:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.130972:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.130978:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131070:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131077:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131083:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400647.131118:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1786400647.131123:0:14213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400647.131144:0:14213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131156:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131164:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131181:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131187:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131193:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400647.131197:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131205:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131218:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:1.0:1786400647.131221:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400647.131226:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131233:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6721 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786400647.131659:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786400647.131812:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131821:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131827:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131832:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400647.131843:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131858:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131868:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9373850bf600) 00010000:00010000:1.0:1786400647.131871:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400647.131874:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131880:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6728 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131926:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a671a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 28 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131939:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 27 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.131946:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:1.0:1786400647.131948:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400647.131950:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe600, rc 0) 00000100:00100000:1.0:1786400647.132020:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+27:14490:x1873176368898432:12345-192.168.201.23@tcp:101:stat.0 Request processed in 1280us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400647.132028:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1786400647.298267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400647.298418:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368898688 00000100:00100000:1.0:1786400647.298428:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368898688 00000100:00100000:1.0:1786400647.298495:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:1.0:1786400647.298506:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+27:14500:x1873176368898688:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1786400647.298544:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400647.298566:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55c0 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400647.298714:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1786400647.298879:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6736 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c0 expref: 29 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.298895:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:1.0:1786400647.298898:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400647.299022:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe400/0x49554f35ff0a6736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c0 expref: 29 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.299039:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe400, rc 0) 00000100:00100000:1.0:1786400647.299101:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+28:14500:x1873176368898688:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 596us (855us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1786400647.299108:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:3.0:1786400647.302942:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400647.303007:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368898944 00000100:00100000:0.0:1786400647.303018:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368898944 00000100:00100000:0.0:1786400647.303076:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:0.0:1786400647.303095:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937385fc7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+28:14500:x1873176368898944:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1786400647.303439:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937385fc7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+29:14500:x1873176368898944:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 353us (505us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1786400647.303447:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1786400647.429434:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400647.429538:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368899200 00000100:00100000:0.0:1786400647.429551:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368899200 00000100:00100000:0.0:1786400647.429620:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:0.0:1786400647.429641:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+29:14506:x1873176368899200:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400647.429672:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400647.429696:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6744 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55c7 expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.429906:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.429920:0:15990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 30 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.429943:0:15990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 30 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.429952:0:15990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.429994:0:15990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 30 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.430009:0:15990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 30 pid: 14213 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400647.430024:0:15990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15990:1873176393004800:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400647.430134:0:15990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 30 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.430144:0:15990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 30 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400647.430153:0:15990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7769500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15990:1873176393004928:192.168.201.23@tcp:104: 00000100:00100000:0.0:1786400647.430175:0:15990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a10c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1786400647.437511:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400647.437641:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368899328 00000100:00100000:1.0:1786400647.437651:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368899328 00010000:00010000:1.0:1786400647.437696:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 31 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400647.437773:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:1.0:1786400647.437783:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+31:2361:x1873176368899328:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400647.437798:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400647.437805:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 31 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.437834:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 31 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.437864:0:14197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:1.0:1786400647.437870:0:14197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.437879:0:14197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.437885:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400647.437959:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+31:2361:x1873176368899328:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 172us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400647.437966:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00010000:00010000:0.0:1786400647.439654:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6680 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5588 expref: 30 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400647.439679:0:15990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7769500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15990:1873176393004928:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400647.440512:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400647.440596:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368899456 00000100:00100000:2.0:1786400647.440604:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368899456 00010000:00010000:2.0:1786400647.440641:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 30 pid: 14213 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400647.440678:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1786400647.440688:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+30:2362:x1873176368899456:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400647.440702:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400647.440708:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 30 pid: 14213 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.440721:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 30 pid: 14213 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.440771:0:14198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:2.0:1786400647.440776:0:14198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.440787:0:14198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.440795:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.440813:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400647.440885:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+30:2362:x1873176368899456:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 197us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400647.440907:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00010000:00010000:0.0:1786400647.441057:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe600/0x49554f35ff0a672f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55b9 expref: 29 pid: 14213 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400647.441073:0:15990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15990:1873176393004800:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400647.441099:0:15990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.441108:0:15990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.441115:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400647.441134:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1786400647.441362:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f200/0x49554f35ff0a6744 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 30 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.441377:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 29 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.441385:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400647.441388:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400647.441390:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5ec00, rc 0) 00000100:00100000:0.0:1786400647.442935:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+29:14506:x1873176368899200:12345-192.168.201.23@tcp:101:bash.0 Request processed in 13287us (13503us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1786400647.442948:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:3.0:1786400647.457099:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400647.458033:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368899712 00000100:00100000:1.0:1786400647.458045:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368899712 00000100:00100000:1.0:1786400647.458147:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:1.0:1786400647.458159:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+29:14506:x1873176368899712:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:1.0:1786400647.458445:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.458461:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.458473:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400647.458525:0:14212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1786400647.458569:0:14212:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000028533975 reply state 000000000b6831ff transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400647.458578:0:14212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400647.458677:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14506:x1873176368899712:12345-192.168.201.23@tcp:36:bash.0 Request processed in 520us (1587us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1786400647.458686:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00000020:00080000:1.0:1786400647.458691:0:14212:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786400647.466875:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:3.0:1786400647.466935:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400647.466949:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400647.469429:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400647.469438:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebe800 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400647.469443:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400647.469453:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400647.469471:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:3.0:1786400647.469473:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400647.469496:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400647.469502:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe800/0x49554f35ff0a6759 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400647.473328:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368899840 00000100:00100000:0.0:1786400647.473346:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368899840 00000100:00100000:0.0:1786400647.473434:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:0.0:1786400647.473446:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+31:14506:x1873176368899840:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1786400647.473470:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400647.473492:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6760 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55ce expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.473558:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6760 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ce expref: 32 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.473574:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6760 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ce expref: 32 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400647.473595:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:0.0:1786400647.473598:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400647.473601:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bea5e200, rc 0) 00000100:00100000:0.0:1786400647.473665:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14506:x1873176368899840:12345-192.168.201.23@tcp:101:bash.0 Request processed in 222us (6801us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400647.473673:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:3.0:1786400647.485736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400647.487625:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368899968 00000100:00100000:0.0:1786400647.487641:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368899968 00000100:00100000:2.0:1786400647.487887:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:2.0:1786400647.487900:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14506:x1873176368899968:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400647.487927:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400647.487951:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a6767 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55d5 expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.488051:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.488068:0:14211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 33 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.488078:0:14211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.488120:0:14211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 33 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.488134:0:14211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 33 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400647.488149:0:14211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14211:1873176393005056:192.168.201.23@tcp:104: 00000100:00100000:2.0:1786400647.488370:0:14211:0:(client.c:2702:ptlrpc_set_wait()) set ffff937387496780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400647.510802:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400647.511038:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368900096 00000100:00100000:1.0:1786400647.511049:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368900096 00010000:00010000:1.0:1786400647.511090:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 34 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400647.511127:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:1.0:1786400647.511137:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+34:2361:x1873176368900096:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400647.511151:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400647.511158:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 34 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.511173:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 34 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.511196:0:14197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:1.0:1786400647.511201:0:14197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.511212:0:14197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.511218:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.511252:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400647.511334:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+34:2361:x1873176368900096:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 198us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400647.511342:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00010000:00010000:2.0:1786400647.511713:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a674b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55c7 expref: 33 pid: 15990 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400647.511777:0:14211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14211:1873176393005056:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400647.511799:0:14211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.511807:0:14211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.511813:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400647.511866:0:14211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1786400647.511871:0:14211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400647.511907:0:14211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.511941:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a6767 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55d5 expref: 33 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.511955:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55d5 expref: 32 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.511963:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:2.0:1786400647.511966:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400647.511969:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102ea00, rc 0) 00000100:00100000:2.0:1786400647.512002:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14506:x1873176368899968:12345-192.168.201.23@tcp:101:bash.0 Request processed in 24104us (26281us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400647.512009:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:0.0:1786400647.522458:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400647.524029:0:16229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368900352 00000100:00100000:3.0:1786400647.524043:0:16229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368900352 00000100:00100000:3.0:1786400647.524125:0:16229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:3.0:1786400647.524137:0:16229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14506:x1873176368900352:12345-192.168.201.23@tcp:103:bash.0 00010000:00010000:3.0:1786400647.524153:0:16229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786400647.524180:0:16229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a676e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55d5 expref: 32 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400647.524204:0:16229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a6760 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ce expref: 31 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400647.524216:0:16229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93739128d000) 00010000:00010000:3.0:1786400647.524225:0:16229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400647.527422:0:16229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+30:14506:x1873176368900352:12345-192.168.201.23@tcp:103:bash.0 Request processed in 3274us (4960us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400647.527440:0:16229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:0.0:1786400647.533621:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400647.534375:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368900480 00000100:00100000:1.0:1786400647.534386:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368900480 00000100:00100000:1.0:1786400647.534448:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1786400647.534459:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+30:14506:x1873176368900480:12345-192.168.201.23@tcp:58:bash.0 00010000:00010000:1.0:1786400647.534572:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.534587:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400647.534599:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786400647.538246:0:14212:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786400647.538435:0:14212:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1786400647.538519:0:14212:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1786400647.538645:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+30:14506:x1873176368900480:12345-192.168.201.23@tcp:58:bash.0 Request processed in 4183us (5028us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400647.538658:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:0.0:1786400647.546637:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400647.546780:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368900608 00000100:00100000:2.0:1786400647.546791:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368900608 00000100:00100000:2.0:1786400647.546866:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:2.0:1786400647.546877:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+30:14506:x1873176368900608:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400647.546898:0:15990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400647.546919:0:15990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a677c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55dc expref: -99 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.546976:0:15990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.546987:0:15990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a677c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55dc expref: 31 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.547006:0:15990:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.547019:0:15990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a677c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55dc expref: 31 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.547032:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9373850bf600) 00010000:00010000:2.0:1786400647.547035:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400647.547039:0:15990:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a677c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55dc expref: 31 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400647.547047:0:15990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102f000, rc 0) 00000100:00100000:2.0:1786400647.547096:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+31:14506:x1873176368900608:12345-192.168.201.23@tcp:101:bash.0 Request processed in 222us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400647.547103:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00010000:00010000:2.0:1786400647.763031:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786400648.212535:0:14243:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1786400648.212546:0:14243:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400648.212584:0:14243:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1786400648.212591:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1786400648.212710:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937391176300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14243:1873176393005184:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400648.212866:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373b9d869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400648.216073:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.216264:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368900736 00000100:00100000:1.0:1786400648.216272:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368900736 00000100:00100000:1.0:1786400648.216317:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1786400648.216326:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14507:x1873176368900736:12345-192.168.201.23@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1786400648.216420:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14507:x1873176368900736:12345-192.168.201.23@tcp:900:lhsmtool_posix.0 Request processed in 94us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400648.216439:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:3.0:1786400648.216697:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937391176300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14243:1873176393005184:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786400648.218256:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400648.218535:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368900864 00000100:00100000:3.0:1786400648.218543:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368900864 00000100:00100000:3.0:1786400648.218596:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:3.0:1786400648.218604:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+31:14507:x1873176368900864:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786400648.218632:0:14213:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786400648.218733:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+31:14507:x1873176368900864:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 129us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400648.218773:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:2.0:1786400648.223036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.224880:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368900992 00000100:00100000:0.0:1786400648.225015:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368900992 00000100:00100000:0.0:1786400648.225196:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:0.0:1786400648.225206:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+31:14507:x1873176368900992:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786400648.225275:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225292:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225304:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225363:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225372:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225379:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225403:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225412:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225418:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400648.225454:0:15990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1786400648.225459:0:15990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400648.225470:0:15990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225486:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225492:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225499:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225505:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5f000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400648.225510:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225517:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225529:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93739128d300) 00010000:00010000:0.0:1786400648.225532:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400648.225536:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225541:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6783 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225554:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225560:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225566:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225575:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400648.225578:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225584:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225590:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93739128d700) 00010000:00010000:0.0:1786400648.225592:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400648.225595:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225600:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a678a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225613:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225619:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225625:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225630:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5ec00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400648.225633:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225639:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225655:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9373850bf600) 00010000:00010000:0.0:1786400648.225657:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400648.225660:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.225667:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ec00/0x49554f35ff0a6791 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400648.225797:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+31:14507:x1873176368900992:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 589us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400648.225805:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:0.0:1786400648.238544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400648.246472:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368901248 00000100:00100000:3.0:1786400648.246490:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368901248 00000100:00100000:1.0:1786400648.246636:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:1.0:1786400648.246647:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+31:14507:x1873176368901248:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400648.246668:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400648.246687:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6798 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55e3 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.246847:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.246861:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.246873:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400648.246894:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1786400648.246995:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247003:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247010:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247015:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:1.0:1786400648.247020:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247045:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247058:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9373850bf600) 00010000:00010000:1.0:1786400648.247060:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400648.247065:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247071:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a679f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247115:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6798 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55e3 expref: 33 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247124:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93739128d300) 00010000:00010000:1.0:1786400648.247126:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400648.247129:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebe200/0x49554f35ff0a6798 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55e3 expref: 33 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.247138:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe200, rc 0) 00000100:00100000:1.0:1786400648.247211:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14507:x1873176368901248:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 565us (8678us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1786400648.247219:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:1.0:1786400648.255142:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.255301:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368901376 00000100:00100000:0.0:1786400648.255312:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368901376 00000100:00100000:0.0:1786400648.255385:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1786400648.255397:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14507:x1873176368901376:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786400648.255432:0:15990:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786400648.255564:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14507:x1873176368901376:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 169us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400648.255572:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:3.0:1786400648.262128:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.262242:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368901632 00000100:00100000:1.0:1786400648.262252:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368901632 00000100:00100000:1.0:1786400648.262318:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:1.0:1786400648.262328:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+32:14507:x1873176368901632:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400648.262372:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400648.262392:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a67ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55ea expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400648.263386:0:14213:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1786400648.263394:0:14213:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1786400648.263446:0:14213:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1786400648.269805:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a67b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.269842:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a67b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.269861:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a67b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.269989:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a67ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ea expref: 35 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.270013:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a67b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ea expref: 34 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.270022:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373850bf500) 00010000:00010000:1.0:1786400648.270025:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400648.270029:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebf600, rc 0) 00000100:00100000:1.0:1786400648.270117:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+34:14507:x1873176368901632:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 7790us (7998us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1786400648.270128:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:1.0:1786400648.280559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.283200:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368901888 00000100:00100000:0.0:1786400648.283223:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368901888 00000100:00100000:0.0:1786400648.283328:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:0.0:1786400648.283339:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+34:14507:x1873176368901888:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786400648.283403:0:15990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400648.283434:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a67b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ea expref: 34 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283469:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373850bf500) 00010000:00010000:0.0:1786400648.283479:0:15990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400648.283503:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283517:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283528:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283543:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283550:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283556:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283635:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283643:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283650:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283655:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5e200 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400648.283660:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283676:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283685:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:0.0:1786400648.283688:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400648.283692:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283698:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5e200/0x49554f35ff0a67c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283709:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283716:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283722:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283727:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5f000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400648.283730:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283736:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283787:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc735140 (ffff93739128d700) 00010000:00010000:0.0:1786400648.283789:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400648.283792:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.283808:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc735140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400648.283920:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+33:14507:x1873176368901888:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 581us (3369us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400648.283928:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:1.0:1786400648.286138:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.286205:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368902016 00000100:00100000:2.0:1786400648.286216:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368902016 00000100:00100000:2.0:1786400648.286289:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:2.0:1786400648.286300:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+33:14507:x1873176368902016:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400648.286322:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400648.286355:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55f1 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.286390:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102fe00/0x49554f35ff0a67d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.286404:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102fe00/0x49554f35ff0a67d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.286416:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102fe00/0x49554f35ff0a67d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.286534:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f1 expref: 35 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.286554:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102fe00/0x49554f35ff0a67d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f1 expref: 34 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.286563:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:2.0:1786400648.286566:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400648.286569:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102fe00, rc 0) 00000100:00100000:2.0:1786400648.286645:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+34:14507:x1873176368902016:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 346us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400648.286661:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:3.0:1786400648.297107:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.297171:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368902272 00000100:00100000:0.0:1786400648.297180:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368902272 00000100:00100000:0.0:1786400648.297249:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:0.0:1786400648.297260:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+34:14507:x1873176368902272:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786400648.297358:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.297376:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.297389:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786400648.298733:0:15990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1786400648.298893:0:15990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 570040153110ns, next at 571040149153ns, rc = 0 00000004:00010000:0.0:1786400648.299008:0:15990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ad01bc1 reply state 000000003440d7ce transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400648.299020:0:15990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786400648.299195:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+36:14507:x1873176368902272:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 1933us (2097us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1786400648.299204:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:1.0:1786400648.307726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:0.0:1786400648.307856:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.307869:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.307878:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.307885:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5f000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:0.0:1786400648.307890:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.307899:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.307919:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:0.0:1786400648.307922:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786400648.307928:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.307933:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a67de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400648.308045:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368902400 00000100:00100000:2.0:1786400648.308057:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368902400 00000100:00100000:2.0:1786400648.308123:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:2.0:1786400648.308134:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+35:14507:x1873176368902400:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400648.308159:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400648.308178:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55f8 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.308248:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 36 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.308262:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 36 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.308280:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:2.0:1786400648.308282:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400648.308285:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102f800, rc 0) 00000100:00100000:2.0:1786400648.308338:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+36:14507:x1873176368902400:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 206us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400648.308346:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:1.0:1786400648.314324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.314505:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368902528 00000100:00100000:2.0:1786400648.314520:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368902528 00000100:00100000:2.0:1786400648.314601:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1786400648.314612:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2361:x1873176368902528:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1786400648.315131:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2361:x1873176368902528:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 519us (815us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1786400648.315156:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00080000:3.0:1786400648.315476:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400648.321154:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.321335:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368902784 00000100:00100000:0.0:1786400648.321345:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368902784 00000100:00100000:0.0:1786400648.321407:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:0.0:1786400648.321419:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937391175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+36:14507:x1873176368902784:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786400648.321685:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937391175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+37:14507:x1873176368902784:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 268us (542us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1786400648.321693:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:1.0:1786400648.330065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.330316:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368903040 00000100:00100000:2.0:1786400648.330325:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368903040 00000100:00100000:2.0:1786400648.330384:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:2.0:1786400648.330394:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+37:14507:x1873176368903040:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786400648.330513:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+37:14507:x1873176368903040:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 119us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400648.330521:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:3.0:1786400648.336000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.336122:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368903168 00000100:00100000:2.0:1786400648.336134:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368903168 00000100:00100000:2.0:1786400648.336247:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:2.0:1786400648.336258:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+37:14507:x1873176368903168:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400648.336283:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400648.336304:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e400/0x49554f35ff0a67ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f55ff expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.336387:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e000/0x49554f35ff0a67f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.336402:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e000/0x49554f35ff0a67f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.336414:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e000/0x49554f35ff0a67f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400648.336453:0:14213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400648.336472:0:14213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e000/0x49554f35ff0a67f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.336513:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e400/0x49554f35ff0a67ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ff expref: 39 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.336530:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e000/0x49554f35ff0a67f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ff expref: 38 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.336539:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:2.0:1786400648.336542:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786400648.336545:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102e000, rc 0) 00000100:00100000:2.0:1786400648.336610:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+38:14507:x1873176368903168:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 354us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400648.336617:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:1.0:1786400648.343930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400648.344023:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368903296 00000100:00100000:3.0:1786400648.344036:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368903296 00000100:00100000:3.0:1786400648.344094:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:3.0:1786400648.344104:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+6:2362:x1873176368903296:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400648.344125:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400648.344151:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5606 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400648.344184:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a4f88, blocks: 0x1 00010000:00010000:3.0:1786400648.344244:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=570s v=(0 0) 00010000:00010000:3.0:1786400648.344249:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400648.344259:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 7 pid: 14851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.344281:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 7 pid: 14851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.344293:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373b7a1f800, rc 0) 00000100:00100000:3.0:1786400648.344364:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+7:2362:x1873176368903296:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 261us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400648.344372:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:1.0:1786400648.350475:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.350538:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368903552 00000100:00100000:0.0:1786400648.350548:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368903552 00000100:00100000:0.0:1786400648.350612:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:0.0:1786400648.350623:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+38:14507:x1873176368903552:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786400648.350788:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+38:14507:x1873176368903552:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 167us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400648.350796:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:2.0:1786400648.358049:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.358146:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368903680 00000100:00100000:0.0:1786400648.358168:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368903680 00000100:00100000:0.0:1786400648.358232:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:0.0:1786400648.358243:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+38:14507:x1873176368903680:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1786400648.413177:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1786400648.413197:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1786400648.413234:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1786400648.413282:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1786400648.413510:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400648.413530:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176393005312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786400648.413588:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400648.413616:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393005312 00000100:00100000:3.0:1786400648.413624:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393005312 00000100:00100000:3.0:1786400648.413676:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786400648.413685:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1873176393005312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786400648.413877:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+13:14507:x1873176368903680:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 55632us (55836us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400648.413904:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00002000:00010000:3.0:1786400648.413995:0:15790:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786400648.413999:0:15790:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1786400648.414000:0:15790:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786400648.414002:0:15790:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1786400648 -> 1786400648 00002000:00010000:3.0:1786400648.414004:0:15790:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786400648.414036:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1873176393005312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 352us (448us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1786400648.414059:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1786400648.414092:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9373b8f44e00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1786400648.414098:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176393005312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786400648.416380:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400648.416491:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368903808 00000100:00100000:3.0:1786400648.416499:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368903808 00000100:00100000:3.0:1786400648.416544:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:3.0:1786400648.416551:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+7:2361:x1873176368903808:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1786400648.416656:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+7:2361:x1873176368903808:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400648.416662:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:1.0:1786400648.418945:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.419082:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368904064 00000100:00100000:0.0:1786400648.419092:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368904064 00000100:00100000:0.0:1786400648.419152:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:0.0:1786400648.419160:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+13:14507:x1873176368904064:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786400648.419217:0:15990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400648.419244:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e000/0x49554f35ff0a67f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55ff expref: 13 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.419266:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:0.0:1786400648.419271:0:15990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400648.419302:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.419329:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.419348:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400648.419546:0:15990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d95ab4a3 reply state 00000000a60340bb transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400648.419556:0:15990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786400648.419643:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+14:14507:x1873176368904064:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 484us (707us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1786400648.419648:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:0.0:1786400648.421542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.421897:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368904192 00000100:00100000:1.0:1786400648.421905:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368904192 00000100:00100000:1.0:1786400648.421965:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:1.0:1786400648.421977:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+7:14507:x1873176368904192:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400648.422004:0:14850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400648.422027:0:14850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f560d expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.422061:0:14850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 8 pid: 14851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.422069:0:14850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400648.422073:0:14850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400648.422079:0:14850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 8 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.422133:0:14850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 8 pid: 14851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.422145:0:14850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 8 pid: 14851 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400648.422156:0:14850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14850:1873176393005440:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400648.422226:0:14850:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a99266c0 going to sleep for 11 seconds 00010000:00010000:3.0:1786400648.423535:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.423548:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.423556:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.423561:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5f000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:3.0:1786400648.423566:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.423574:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.423590:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:3.0:1786400648.423593:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400648.423598:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.423622:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5f000/0x49554f35ff0a6801 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400648.425135:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.425264:0:14850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14850:1873176393005440:192.168.201.23@tcp:104: 00010000:00010000:0.0:1786400648.425298:0:14850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 8 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.425319:0:14850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9373bfebe800, rc 0) 00000100:00100000:0.0:1786400648.425389:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+8:14507:x1873176368904192:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 3413us (3850us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400648.425398:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:3.0:1786400648.426111:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368904320 00000100:00100000:3.0:1786400648.426120:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368904320 00010000:00010000:3.0:1786400648.426158:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 8 pid: 14851 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400648.426194:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:3.0:1786400648.426203:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+8:2361:x1873176368904320:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400648.426216:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400648.426238:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 8 pid: 14851 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.426251:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 8 pid: 14851 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.426273:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a67fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5606 expref: 8 pid: 14851 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.426287:0:14197:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400648.426291:0:14197:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400648.426297:0:14197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 7 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.426327:0:14197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 7 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.426364:0:14197:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 7 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400648.426391:0:14197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14197:1873176393005568:192.168.201.23@tcp:105: 00000100:00100000:3.0:1786400648.426468:0:14197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373840b8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400648.436820:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.437170:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368904448 00000100:00100000:0.0:1786400648.437180:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368904448 00000100:00100000:0.0:1786400648.437246:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1786400648.437257:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+8:2362:x1873176368904448:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786400648.437483:0:14851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786400648.437487:0:14851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1786400647 00002000:00010000:0.0:1786400648.437490:0:14851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1786400645 00002000:00010000:0.0:1786400648.437492:0:14851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1786400648 -> 1786400647 00002000:00010000:0.0:1786400648.437494:0:14851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786400648.437562:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+9:2362:x1873176368904448:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 306us (752us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1786400648.437570:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:3.0:1786400648.437807:0:14197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14197:1873176393005568:192.168.201.23@tcp:105: 00010000:00010000:3.0:1786400648.437839:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400648.437870:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+8:2361:x1873176368904320:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 11668us (12745us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400648.437880:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1786400648.444287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1786400648.444714:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368904576 00000100:00100000:3.0:1786400648.444727:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368904576 00000100:00100000:3.0:1786400648.444822:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:3.0:1786400648.444851:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+8:2359:x1873176368904576:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786400648.445099:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.445125:0:15790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 8 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.445154:0:15790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400648.445158:0:15790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400648.445163:0:15790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.445204:0:15790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 8 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.445218:0:15790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 8 pid: 14850 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400648.445235:0:15790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15790:1873176393005696:192.168.201.23@tcp:104: 00000100:00100000:3.0:1786400648.445327:0:15790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373840b8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400648.448640:0:15790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15790:1873176393005696:192.168.201.23@tcp:104: 00010000:00010000:3.0:1786400648.448674:0:15790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400648.451102:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1786400648.452109:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368904704 00000100:00100000:0.0:1786400648.452123:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368904704 00010000:00010000:0.0:1786400648.452176:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 9 pid: 14850 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400648.452276:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:0.0:1786400648.452287:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+9:2362:x1873176368904704:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400648.452305:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400648.452340:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 9 pid: 14850 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.452355:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 9 pid: 14850 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.452453:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000834b2d14/0x49554f35ff0a6808 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f560d expref: 9 pid: 14850 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.452497:0:14198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400648.452502:0:14198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400648.452508:0:14198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.452518:0:14198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.452556:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400648.452633:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+8:2362:x1873176368904704:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 348us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400648.452641:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00010000:00010000:2.0:1786400648.452709:0:15790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.452719:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.452764:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.452787:0:15790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.452796:0:15790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.452802:0:15790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373b7a1f800 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400648.452807:0:15790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.452816:0:15790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.452849:0:15790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.452862:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de5f9078/0x49554f35ff0a680f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400648.452931:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+7:2359:x1873176368904576:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 8091us (8656us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400648.452940:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:2.0:1786400648.456064:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.456143:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368904960 00000100:00100000:1.0:1786400648.456152:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368904960 00000100:00100000:1.0:1786400648.456213:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:1.0:1786400648.456224:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+13:14507:x1873176368904960:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786400648.456306:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.456323:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.456345:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.456719:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.456732:0:14213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 14 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.456782:0:14213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.456819:0:14213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 14 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400648.456842:0:14213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 14 pid: 14213 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400648.456858:0:14213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14213:1873176393005824:192.168.201.23@tcp:104: 00000100:00100000:1.0:1786400648.457088:0:14213:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373a99266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400648.460811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.460942:0:14213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14213:1873176393005824:192.168.201.23@tcp:104: 00010000:00010000:2.0:1786400648.460992:0:14213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400648.461189:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368905088 00000100:00100000:3.0:1786400648.461197:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368905088 00010000:00010000:3.0:1786400648.461236:0:14196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 15 pid: 14213 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400648.461273:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:3.0:1786400648.461282:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373c00a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+15:2361:x1873176368905088:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400648.461303:0:14196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400648.461311:0:14196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 15 pid: 14213 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.461323:0:14196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 15 pid: 14213 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.461357:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f800/0x49554f35ff0a67e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55f8 expref: 15 pid: 14213 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.461492:0:14196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:3.0:1786400648.461498:0:14196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.461509:0:14196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.461517:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.461538:0:14196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400648.461594:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373c00a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+14:2361:x1873176368905088:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 311us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400648.461602:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00010000:00010000:2.0:1786400648.462618:0:14213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.462631:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400648.462894:0:14213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1786400648.464324:0:14213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1786400648.464616:0:14213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1786400648.464720:0:14213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a19880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14213:1873176393005952:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786400648.465160:0:14213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400648.465204:0:14213:0:(client.c:2702:ptlrpc_set_wait()) set ffff937390bc6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400648.465352:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393005952 00000100:00100000:1.0:1786400648.465360:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393005952 00000100:00100000:1.0:1786400648.465417:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400648.465427:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14213:x1873176393005952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786400648.465514:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14213:x1873176393005952:12345-0@lo:1000:mdt00_002.0 Request processed in 88us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400648.465522:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400648.465792:0:14213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a19880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14213:1873176393005952:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1786400648.467185:0:14213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1786400648.467276:0:14213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a19880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14213:1873176393006080:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786400648.467508:0:14213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400648.467546:0:14213:0:(client.c:2702:ptlrpc_set_wait()) set ffff937385fba240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400648.467678:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393006080 00000100:00100000:0.0:1786400648.467686:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393006080 00000100:00100000:0.0:1786400648.467735:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786400648.467778:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14213:x1873176393006080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786400648.468289:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14213:x1873176393006080:12345-0@lo:1000:mdt00_002.0 Request processed in 512us (956us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1786400648.468298:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400648.468504:0:14213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a19880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14213:1873176393006080:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1786400648.468546:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468557:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468564:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468585:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400648.468590:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468598:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468616:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:2.0:1786400648.468619:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400648.468624:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468630:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf600/0x49554f35ff0a681d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468668:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468675:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468680:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468685:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf400 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400648.468688:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468694:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468711:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9373850bf600) 00010000:00010000:2.0:1786400648.468713:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400648.468721:0:14213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a677c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55dc expref: 17 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.468733:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a677c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55dc expref: 17 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.469169:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a677c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55dc expref: 17 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400648.469727:0:14213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93739102f000/0x49554f35ff0a677c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f55dc expref: 17 pid: 15990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400648.470093:0:14213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c90000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14213:1873176393006208:192.168.201.23@tcp:105: 00000100:00100000:2.0:1786400648.470325:0:14213:0:(client.c:2702:ptlrpc_set_wait()) set ffff9373840b8300 going to sleep for 11 seconds 00000100:00100000:1.0:1786400648.474953:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.475174:0:14213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c90000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14213:1873176393006208:192.168.201.23@tcp:105: 00010000:00010000:2.0:1786400648.475204:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475215:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf400/0x49554f35ff0a6775 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475249:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475262:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475274:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475286:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475307:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475313:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475319:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102e600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400648.475324:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475332:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475344:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9373850bf600) 00010000:00010000:2.0:1786400648.475347:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400648.475350:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475356:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6824 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475376:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475383:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475389:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475393:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bfebf000 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400648.475403:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475410:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475419:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9373850bf600) 00010000:00010000:2.0:1786400648.475421:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400648.475424:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.475430:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bfebf000/0x49554f35ff0a6816 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400648.475670:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fe1f16-deaa-49ac-af27-b01352c851d6+17:14507:x1873176368904960:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 19447us (19775us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1786400648.475682:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000020:00080000:2.0:1786400648.475689:0:14213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1786400648.476153:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368905216 00000100:00100000:0.0:1786400648.476161:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368905216 00000100:00100000:0.0:1786400648.476217:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:0.0:1786400648.476226:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+17:14506:x1873176368905216:12345-192.168.201.23@tcp:49:bash.0 00000100:00100000:0.0:1786400648.476332:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+17:14506:x1873176368905216:12345-192.168.201.23@tcp:49:bash.0 Request processed in 106us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400648.476356:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000040:00080000:1.0:1786400648.476891:0:14243:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786400648.476898:0:14243:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400648.476930:0:14243:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1786400648.476936:0:14243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1786400648.480997:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.481099:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.481156:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.481187:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.481216:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400648.481247:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368906112 00000100:00100000:1.0:1786400648.481258:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368906112 00000100:00100000:1.0:1786400648.481321:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368905728 00000100:00100000:1.0:1786400648.481324:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368905728 00000100:00100000:1.0:1786400648.481354:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368905984 00000100:00100000:1.0:1786400648.481357:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368905984 00000100:00100000:1.0:1786400648.481379:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:1.0:1786400648.481390:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2360:x1873176368906112:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400648.481473:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2360:x1873176368906112:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400648.481482:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:1.0:1786400648.481500:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1786400648.481506:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2360:x1873176368905728:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400648.481529:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+5:2360:x1873176368905728:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400648.481535:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1786400648.481546:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:1.0:1786400648.481552:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2360:x1873176368905984:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1786400648.481574:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f319fa2-685e-40ac-bcb2-a030582224fd+5:2360:x1873176368905984:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 22us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400648.481580:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00080000:1.0:1786400648.481596:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786400648.481600:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400648.481892:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368905856 00000100:00100000:2.0:1786400648.481897:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368905856 00000100:00100000:2.0:1786400648.481935:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:2.0:1786400648.481943:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2360:x1873176368905856:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1786400648.481979:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f319fa2-685e-40ac-bcb2-a030582224fd+6:2360:x1873176368905856:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 37us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400648.481986:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00080000:2.0:1786400648.482005:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400648.484515:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368905600 00000100:00100000:0.0:1786400648.484531:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368905600 00000100:00100000:0.0:1786400648.484598:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:0.0:1786400648.484608:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:2360:x1873176368905600:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1786400648.484779:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94bcc1b7-8c16-472b-9a98-ebe81d5fcd7e+13:2360:x1873176368905600:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 173us (3794us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400648.484787:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:2.0:1786400648.486078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.486112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.486145:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368906240 00000100:00100000:2.0:1786400648.486168:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368906240 00000100:00100000:2.0:1786400648.486215:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:2.0:1786400648.486223:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+7:14506:x1873176368906240:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1786400648.486242:0:14849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400648.486265:0:14849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a682b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f5614 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400648.486299:0:14849:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a7a4f87, atime: 0x6a7a4f85, ctime: 0x6a7a4f87, blocks: 0x1 00010000:00010000:2.0:1786400648.486322:0:14849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1786400648.486327:0:14849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1786400648.486476:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368905472 00000100:00100000:0.0:1786400648.486482:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368905472 00000100:00100000:0.0:1786400648.486514:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:0.0:1786400648.486522:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b7a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+17:14507:x1873176368905472:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786400648.487418:0:14214:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786400648.487534:0:14214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1786400648.487580:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.487596:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.487608:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.487617:0:14214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.487623:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.487642:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400648.487665:0:14214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786400648.487777:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+19:14507:x1873176368905472:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1254us (1703us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1786400648.487786:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000020:00080000:0.0:1786400648.487792:0:14214:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786400648.488004:0:14849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a682b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5614 expref: 8 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.488022:0:14849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003cf8e759/0x49554f35ff0a682b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f5614 expref: 8 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.488036:0:14849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102fa00, rc 0) 00000100:00100000:2.0:1786400648.488062:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+8:14506:x1873176368906240:12345-192.168.201.23@tcp:101:bash.0 Request processed in 1840us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400648.488068:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00010000:00010000:2.0:1786400648.491914:0:14199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400648.491931:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.491943:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9373bea5ea00 already unused, calling callback (ffffffffc17e3e90) 00010000:00010000:2.0:1786400648.491948:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.491982:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.492001:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9373a10f4900) 00010000:00010000:2.0:1786400648.492004:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786400648.492009:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.492015:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9373bea5ea00/0x49554f35ff0a6832 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.492033:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400648.492035:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400648.492037:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400648.492814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.493032:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368906496 00000100:00100000:2.0:1786400648.493042:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368906496 00000100:00100000:2.0:1786400648.493103:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1786400648.493114:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+19:14506:x1873176368906496:12345-192.168.201.23@tcp:35:bash.0 00000001:00080000:2.0:1786400648.493490:0:14214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1786400648.493585:0:14214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1786400648.493795:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+22:14506:x1873176368906496:12345-192.168.201.23@tcp:35:bash.0 Request processed in 681us (984us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1786400648.493805:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000020:00080000:2.0:1786400648.493810:0:14214:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1786400648.599714:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.600088:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368906752 00000100:00100000:2.0:1786400648.600101:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368906752 00000100:00100000:2.0:1786400648.600175:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:2.0:1786400648.600186:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+22:14517:x1873176368906752:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1786400648.600231:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400648.600252:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6839 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd7e71bb6b4f561b expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400648.600525:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1786400648.600697:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6839 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f561b expref: 24 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.600711:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9373850bf900) 00010000:00010000:2.0:1786400648.600714:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400648.600718:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6839 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xdd7e71bb6b4f561b expref: 24 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.600730:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93739102e600, rc 0) 00000100:00100000:2.0:1786400648.601501:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+23:14517:x1873176368906752:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1312us (1799us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1786400648.601511:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:1.0:1786400648.606077:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.606162:0:15990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368906880 00000100:00100000:2.0:1786400648.606173:0:15990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368906880 00000100:00100000:2.0:1786400648.606238:0:15990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:2.0:1786400648.606249:0:15990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+23:14517:x1873176368906880:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:2.0:1786400648.606326:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606354:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606367:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606395:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606402:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606408:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606704:0:15990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606714:0:15990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606721:0:15990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400648.606793:0:15990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606806:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606812:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606819:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606834:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102e600 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400648.606839:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606855:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606868:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93739128d800) 00010000:00010000:2.0:1786400648.606871:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400648.606876:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606948:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102e600/0x49554f35ff0a6847 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606964:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606970:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606975:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606980:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102ec00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400648.606983:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606989:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.606996:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9373a10f4a00) 00010000:00010000:2.0:1786400648.606998:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400648.607001:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.607018:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ec00/0x49554f35ff0a684e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.607036:0:15990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.607041:0:15990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.607046:0:15990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.607051:0:15990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93739102ea00 already unused, calling callback (ffffffffc21ea4f0) 00010000:00010000:2.0:1786400648.607054:0:15990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.607059:0:15990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.607066:0:15990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9373850bf600) 00010000:00010000:2.0:1786400648.607068:0:15990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400648.607070:0:15990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400648.607076:0:15990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93739102ea00/0x49554f35ff0a6855 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400648.607149:0:15990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fe1f16-deaa-49ac-af27-b01352c851d6+23:14517:x1873176368906880:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 901us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400648.607157:0:15990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1786400648.610445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400648.610539:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368907136 00000100:00100000:2.0:1786400648.610550:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368907136 00000100:00100000:2.0:1786400648.610614:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:2.0:1786400648.610623:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+23:14517:x1873176368907136:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1786400648.611194:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+24:14517:x1873176368907136:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 569us (758us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1786400648.611203:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00010000:00010000:2.0:1786400648.786954:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400649.810943:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400650.524002:0:16380:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1786400650.647156:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400650.647180:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b8f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176393006336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400650.647255:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400650.647698:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393006336 00000100:00100000:2.0:1786400650.647706:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393006336 00000100:00100000:2.0:1786400650.647781:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786400650.647801:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176393006336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400650.647835:0:14853:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400650.647885:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1873176393006336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400650.647893:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786400650.647918:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176393006592:0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.647947:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400650.647970:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400650.647976:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176393006720:0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.647998:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786400650.648020:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400650.648034:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9373b7a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3316:1873176393006464:0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.648060:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400650.648095:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176393006976:0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.648120:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400650.648154:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b8f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1873176393006336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400650.648170:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400650.648175:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176393006848:0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.648194:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400650.648217:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393006720 00000100:00100000:2.0:1786400650.648221:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393006720 00000100:00100000:2.0:1786400650.648245:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393006976 00000100:00100000:2.0:1786400650.648249:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393006976 00000100:00100000:2.0:1786400650.648265:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393006848 00000100:00100000:2.0:1786400650.648268:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393006848 00000100:00100000:2.0:1786400650.648281:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786400650.648287:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176393006720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.648319:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1873176393006720:12345-0@lo:400:kworker.0 Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400650.648325:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786400650.648337:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786400650.648343:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176393006976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.648370:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1873176393006976:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400650.648395:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786400650.648408:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786400650.648415:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176393006848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.648439:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1873176393006848:12345-0@lo:400:kworker.0 Request processed in 25us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400650.648454:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1786400650.648472:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400650.648489:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1873176393006720:0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.648508:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1873176393006848:0@lo:400:kworker.0 00000100:00100000:2.0:1786400650.648517:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1873176393006976:0@lo:400:kworker.0 00000100:00100000:0.0:1786400650.655042:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393006592 00000100:00100000:0.0:1786400650.655058:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393006592 00000100:00100000:0.0:1786400650.655145:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786400650.655156:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1873176393006592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400650.655258:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1873176393006592:12345-0@lo:400:kworker.0 Request processed in 104us (7309us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400650.655266:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786400650.655298:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393006464 00000100:00100000:0.0:1786400650.655301:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393006464 00000100:00100000:0.0:1786400650.655327:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1786400650.655334:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93739065dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3316:x1873176393006464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400650.655373:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93739065dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c+19:3316:x1873176393006464:12345-0@lo:400:kworker.0 Request processed in 40us (7312us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400650.655379:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1786400650.655412:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400650.655451:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1873176393006592:0@lo:400:kworker.0 00000100:00100000:0.0:1786400650.655489:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9373b7a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0311c05a-56b5-4d5c-8a54-b3e546b2fc8c:3316:1873176393006464:0@lo:400:kworker.0 00010000:00010000:2.0:1786400650.835076:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400651.578065:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1786400651.578113:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1786400651.578226:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368907264 00000100:00100000:2.0:1786400651.578237:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368907264 00002000:00100000:2.0:1786400651.578362:0:14855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9373b8f45180 x1873176368907264/t0(0) o4->96fe1f16-deaa-49ac-af27-b01352c851d6@192.168.201.23@tcp:447/0 lens 504/0 e 0 to 0 dl 1786400662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1786400651.578374:0:14855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b8f45180 with x1873176368907264 ext(0->8) 00002000:00010000:2.0:1786400651.578381:0:14855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b8f45180 00000100:00100000:2.0:1786400651.578406:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:2.0:1786400651.578417:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+8:2359:x1873176368907264:12345-192.168.201.23@tcp:4:bash.0 00000100:00080000:1.0:1786400651.581660:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400651.582233:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96fe1f16-deaa-49ac-af27-b01352c851d6+10:2359:x1873176368907264:12345-192.168.201.23@tcp:4:bash.0 Request processed in 3810us (4169us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1786400651.582247:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00002000:00100000:2.0:1786400651.582259:0:14855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9373b8f45180 x1873176368907264/t8589934598(0) o4->96fe1f16-deaa-49ac-af27-b01352c851d6@192.168.201.23@tcp:447/0 lens 504/448 e 0 to 0 dl 1786400662 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1786400651.582270:0:14855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9373b8f45180 with x1873176368907264 ext(0->8) 00002000:00010000:2.0:1786400651.582285:0:14855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9373b8f45180 00000100:00100000:3.0:1786400651.590104:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176368907392 00000100:00100000:3.0:1786400651.590121:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176368907392 00000100:00100000:2.0:1786400651.592550:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:2.0:1786400651.592562:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9373b8f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+10:2360:x1873176368907392:12345-192.168.201.23@tcp:16:kworker.0 00000100:00100000:2.0:1786400651.667550:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9373b8f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fe1f16-deaa-49ac-af27-b01352c851d6+10:2360:x1873176368907392:12345-192.168.201.23@tcp:16:kworker.0 Request processed in 74981us (89427us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400651.667564:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000001:00080000:0.0:1786400651.667655:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1786400651.667670:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1786400651.667676:0:6647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:2.0:1786400651.859203:0:14199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400652.178892:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400652.178928:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff937388c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393007104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400652.179424:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400652.179552:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176393007104 00000100:00100000:0.0:1786400652.179563:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176393007104 00000100:00100000:0.0:1786400652.179635:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400652.179645:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937388c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393007104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400652.179667:0:14853:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1786400652.179712:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937388c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1873176393007104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400652.179719:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1786400652.179874:0:14207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400652.179903:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1786400652.179908:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9373b8f44e00, transno 8589934595 00000004:00080000:3.0:1786400652.179933:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1786400652.180454:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff937388c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1873176393007104:0@lo:13:osp-pre-0-0.0 Debug log: 30150 lines, 30150 kept, 0 dropped, 0 bad.